00000001:02000400:2.0F:1786100329.231077:0:2962:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1786100346.553966:0:3181:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1786100348.502568:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 609 MB/s 00000001:01000000:3.0F:1786100348.753005:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 529 MB/s 00000001:01000000:0.0:1786100349.002941:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3671 MB/s 00000020:02000000:2.0:1786100349.742532:0:3274:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.56_50_gf5ff674 00000400:02000000:1.0F:1786100350.587140:0:3289:0:(api-ni.c:2822:lnet_startup_lndni()) Added LNI 192.168.206.153@tcp [8/256/0/180] 00008000:02000000:3.0:1786100353.896555:0:3438:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1786100404.308193:0:5241:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1786100412.534514:0:5823:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786100412.534519:0:5823:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1786100412.534734:0:5823:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000fe98c770 00000080:02000400:2.0:1786100412.534743:0:5823:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1786100412.539742:0:5823:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1786100412.539755:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1786100412.539928:0:5823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a0d61a9e) 00000020:00000080:3.0:1786100412.539959:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1786100412.555306:0:5823:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1786100412.555695:0:5823:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1786100412.577403:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1786100412.577439:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1786100412.577458:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1786100412.577502:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1786100412.577524:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1786100412.577945:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1786100412.578086:0:5823:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1786100412.578098:0:5823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac0a15 00000020:01000004:2.0:1786100412.578107:0:5823:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1786100412.578111:0:5823:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1786100412.578115:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fe98c770 from MGS 00000020:01000004:2.0:1786100412.578119:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1786100412.578147:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001f48393f) 00000020:00000080:2.0:1786100412.578159:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1786100412.578217:0:5823:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fe98c770 from MGS, refs=2 00080000:01000000:2.0:1786100412.578222:0:5823:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1786100412.578227:0:5823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac0a23 00000100:00100000:2.0:1786100412.578320:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1786100412.578437:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1786100412.578443:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1786100412.579187:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1786100412.579195:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1786100412.580238:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786100412.580437:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1786100412.580443:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1786100412.581563:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1786100412.581573:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1786100412.582262:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1786100412.582268:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1786100412.583209:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100412.583213:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100412.583215:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100412.583487:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100412.583489:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100412.583491:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100412.584405:0:5823:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1786100412.591296:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1786100412.833742:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4615 MB/s 00000001:01000000:0.0:1786100413.083787:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4667 MB/s 00000001:01000000:3.0:1786100413.335239:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 617 MB/s 00000001:01000000:2.0:1786100413.584840:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1003 MB/s 00080000:10000000:2.0:1786100413.592534:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1786100413.602683:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1786100413.602698:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1786100413.602701:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1786100413.603324:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1786100413.603378:0:5823:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1786100413.603419:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1786100413.603628:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1786100413.603797:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1786100413.604263:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786100413.604399:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1786100413.604405:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:1.0:1786100413.608641:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100413.610089:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1786100413.610103:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1786100413.610456:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1786100413.610463:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1786100413.611029:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1786100413.611047:0:5823:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.153@tcp' 00000020:01000004:0.0:1786100413.611049:0:5823:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1786100413.611096:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.153@tcp (typ=mgc) 00000020:00000080:0.0:1786100413.611116:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.153@tcp (0000000067aceb18) 00000020:00000080:0.0:1786100413.611133:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1786100413.611269:0:5823:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006ba9b00d@MGC192.168.206.153@tcp: add connection 192.168.206.153@tcp at head 00010000:00010000:0.0:1786100413.611425:0:5823:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.153@tcp-0 is initialized 00000040:01000000:0.0:1786100413.611432:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 1 is initialized 10000000:01000000:0.0:1786100413.614116:0:5840:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1786100413.614157:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.153@tcp (uuid 28d1ade7-51d1-4427-9c4d-d62141c5468b) 00000020:00000080:0.0:1786100413.614177:0:5823:0:(genops.c:1406:class_connect()) connect: client 28d1ade7-51d1-4427-9c4d-d62141c5468b, cookie 0x5564f2c20ac0a31 00000100:00080000:0.0:1786100413.614190:0:5823:0:(import.c:510:import_select_connection()) MGC192.168.206.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786100413.614195:0:5823:0:(import.c:624:import_select_connection()) MGC192.168.206.153@tcp: import 000000006ba9b00d using connection 192.168.206.153@tcp/0@lo 00000100:00100000:0.0:1786100413.614576:0:5823:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000625c99e6 x1872861960601728/t0(0) o250->MGC192.168.206.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786100413.614597:0:5823:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 28d1ade7-51d1-4427-9c4d-d62141c5468b->MGS 00000020:01000004:0.0:1786100413.614620:0:5823:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1786100413.614625:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1786100413.614637:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e2d208c7) 00000020:00000080:0.0:1786100413.614648:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1786100413.615394:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000625c99e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28d1ade7-51d1-4427-9c4d-d62141c5468b:3304:1872861960601728:0@lo:250: 00000100:00100000:2.0:1786100413.615487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100413.615546:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960601728 00000100:00100000:2.0:1786100413.615553:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960601728 00000100:00100000:2.0:1786100413.615579:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786100413.615585:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd02e223 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1872861960601728:12345-0@lo:250: 00010000:00080000:2.0:1786100413.615607:0:5835:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 28d1ade7-51d1-4427-9c4d-d62141c5468b@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:2.0:1786100413.615639:0:5835:0:(genops.c:1406:class_connect()) connect: client 28d1ade7-51d1-4427-9c4d-d62141c5468b, cookie 0x5564f2c20ac0a3f 00000100:00080000:2.0:1786100413.615773:0:5835:0:(import.c:65:import_set_state_nolock()) 0000000021dfc394 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786100413.615819:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd02e223 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:3304:x1872861960601728:12345-0@lo:250: Request processed in 233us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100413.615826:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786100413.615862:0:3304:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.206.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1786100413.615868:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.153@tcp: connect to target with instance 0 00000100:00080000:2.0:1786100413.615874:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1786100413.615878:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1786100413.615881:0:3304:0:(import.c:65:import_set_state_nolock()) 000000006ba9b00d MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1786100413.615883:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1786100413.615886:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1786100413.615890:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000625c99e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28d1ade7-51d1-4427-9c4d-d62141c5468b:3304:1872861960601728:0@lo:250: 00000100:00080000:2.0:1786100413.616054:0:5839:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1786100413.624486:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786100413.624697:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1786100413.624705:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1786100413.628950:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1786100413.628961:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1786100413.629294:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1786100413.629300:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1786100413.630065:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786100413.630244:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1786100413.630250:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1786100413.640179:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1786100413.640193:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1786100413.674142:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786100413.674326:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1786100413.674344:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1786100413.675435:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1786100413.675445:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1786100413.677245:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786100413.677404:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1786100413.677410:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1786100413.678385:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1786100413.678391:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1786100413.679161:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786100413.679307:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1786100413.679312:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1786100413.679816:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1786100413.679823:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1786100413.680444:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786100413.680575:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1786100413.680580:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1786100413.681211:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1786100413.681218:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1786100413.706946:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786100413.707598:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1786100413.707604:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1786100413.710529:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1786100413.710542:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1786100413.711544:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1786100413.711553:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1786100413.713121:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1786100413.713144:0:5823:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1786100413.713149:0:5823:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1786100413.713275:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 0 is initialized 00000020:01000004:1.0:1786100413.713306:0:5823:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.153@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1786100413.713311:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1786100413.713316:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786100413.713317:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786100413.713318:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786100413.713319:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786100413.713320:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786100413.713321:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786100413.713322:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786100413.713323:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786100413.713324:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786100413.713325:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786100413.713326:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786100413.713328:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1786100413.713330:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786100413.713331:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786100413.713332:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786100413.713333:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786100413.713334:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786100413.713335:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786100413.713335:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786100413.713336:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786100413.713337:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786100413.713338:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786100413.713338:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786100413.713339:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786100413.713369:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1786100413.713385:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000df67ca10 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960601856:0@lo:253: 00000100:00100000:1.0:1786100413.713456:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100413.713546:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 0000000005096a9f going to sleep for 11 seconds 00000100:00100000:0.0:1786100413.713588:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960601856 00000100:00100000:0.0:1786100413.713595:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960601856 00000100:00100000:0.0:1786100413.713817:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786100413.713826:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fde35587 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:5823:x1872861960601856:12345-0@lo:253: 20000000:01000000:0.0:1786100413.713869:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1786100413.713872:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1786100413.714699:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1786100413.714763:0:5838:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1786100413.715587:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786100413.717222:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1786100413.717430:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1786100413.717434:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1786100413.717440:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1786100413.717442:0:5838:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1786100413.717459:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1786100413.717963:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786100413.718428:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1786100413.718443:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1786100413.718490:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1786100413.718539:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1786100413.718588:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1786100413.718721:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1786100413.718730:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1786100413.718774:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1786100413.718782:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1786100413.718813:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1786100413.718820:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1786100413.718852:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1786100413.718899:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1786100413.718930:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1786100413.718935:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1786100413.718948:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786100413.719188:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1786100413.719198:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1786100413.719233:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1786100413.719267:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1786100413.719316:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1786100413.719329:0:5838:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1786100413.719398:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1786100413.719407:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1786100413.719451:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1786100413.719488:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1786100413.719524:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1786100413.719537:0:5838:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1786100413.719630:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1786100413.719640:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1786100413.719700:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1786100413.719752:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1786100413.719908:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1786100413.719952:0:5838:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1786100413.719959:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1786100413.720802:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1786100413.721209:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1786100413.721233:0:5838:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.153@tcp for mdt 20000000:01000000:1.0:1786100413.721235:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.153@tcp (null) (null) (null) 00000040:00080000:1.0:1786100413.721273:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1786100413.721282:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1786100413.721314:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1786100413.721322:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.153@tcp (null) (null) 00000040:00080000:1.0:1786100413.721366:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1786100413.721376:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1786100413.721421:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1786100413.721457:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1786100413.721518:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1786100413.721522:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1786100413.721525:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1786100413.721547:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1786100413.721550:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1786100413.721578:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1786100413.721580:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1786100413.722059:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1786100413.722289:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1786100413.722326:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1786100413.722391:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1786100413.722404:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1786100413.722406:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1786100413.722919:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1786100413.723260:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1786100413.723300:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1786100413.723336:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1786100413.723353:0:5838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786100413.723355:0:5838:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1786100413.723359:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1786100413.723362:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1786100413.723366:0:5838:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1786100413.723371:0:5838:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1786100413.723896:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1786100413.724140:0:5838:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1786100413.732822:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1786100413.732886:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1786100413.732960:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1786100413.733057:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1786100413.733077:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f4cdbadf/0x5564f2c20ac0a46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100413.733091:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f4cdbadf/0x5564f2c20ac0a46 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100413.733101:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f4cdbadf/0x5564f2c20ac0a46 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100413.733122:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f4cdbadf/0x5564f2c20ac0a46 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100413.733128:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f4cdbadf/0x5564f2c20ac0a46 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100413.733134:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f4cdbadf/0x5564f2c20ac0a46 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100413.733140:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f4cdbadf already unused, calling callback (000000003d539495) 00010000:00010000:0.0:1786100413.733143:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f4cdbadf/0x5564f2c20ac0a46 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100413.733149:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f4cdbadf/0x5564f2c20ac0a46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100413.733160:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f4cdbadf/0x5564f2c20ac0a46 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100413.733166:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f4cdbadf/0x5564f2c20ac0a46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100413.733172:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f4cdbadf/0x5564f2c20ac0a46 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786100413.733188:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1786100413.907863:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fde35587 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:5823:x1872861960601856:12345-0@lo:253: Request processed in 194033us (194401us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100413.907884:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786100413.908000:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000df67ca10 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960601856:0@lo:253: 10000000:01000000:2.0:1786100413.908016:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1786100413.908019:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786100413.908021:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786100413.908022:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786100413.908023:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1786100413.908024:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786100413.908025:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786100413.908027:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786100413.908028:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786100413.908029:0:5823:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1786100413.908031:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786100413.908032:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1786100413.908049:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fe98c770 from lustre-MDT0000 10000000:01000000:2.0:1786100413.908075:0:5823:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1786100413.908078:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1786100413.908082:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a3c44f34d40 10000000:01000000:2.0:1786100413.908086:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786100413.908093:0:5823:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a3c44f34d40 from 1 10000000:01000000:2.0:1786100413.908096:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786100413.908149:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 00000000c0c00d40/0x5564f2c20ac0a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100413.908160:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 00000000c0c00d40/0x5564f2c20ac0a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100413.908168:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 00000000c0c00d40/0x5564f2c20ac0a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100413.908186:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000949b322 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960601984:0@lo:101: 00000100:00100000:2.0:1786100413.908231:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100413.908321:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 0000000047464d24 going to sleep for 11 seconds 00000100:00100000:3.0:1786100413.908435:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960601984 00000100:00100000:3.0:1786100413.908441:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960601984 00000100:00100000:3.0:1786100413.908589:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786100413.908597:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1264c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:5823:x1872861960601984:12345-0@lo:101: 00010000:00010000:3.0:1786100413.908610:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100413.908622:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000487ad1f/0x5564f2c20ac0a54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0a4d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100413.908643:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000487ad1f/0x5564f2c20ac0a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0a4d expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100413.908682:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000487ad1f/0x5564f2c20ac0a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0a4d expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100413.908690:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000487ad1f, rc 0) 00000100:00100000:3.0:1786100413.908730:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1264c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+6:5823:x1872861960601984:12345-0@lo:101: Request processed in 133us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100413.908735:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786100413.908797:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000949b322 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960601984:0@lo:101: 00010000:00010000:1.0:1786100413.908809:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 00000000c0c00d40/0x5564f2c20ac0a4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0a54 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100413.908817:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 00000000c0c00d40/0x5564f2c20ac0a4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0a54 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100413.908859:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960602112:0@lo:501: 00000100:00100000:1.0:1786100413.908882:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100413.909149:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 00000000995c90a2 going to sleep for 11 seconds 00000100:00100000:2.0:1786100413.909215:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960602112 00000100:00100000:2.0:1786100413.909219:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960602112 00000100:00100000:2.0:1786100413.909241:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786100413.909246:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002338b29e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+6:5823:x1872861960602112:12345-0@lo:501: 00000100:00100000:2.0:1786100413.909444:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002338b29e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+6:5823:x1872861960602112:12345-0@lo:501: Request processed in 198us (561us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786100413.909452:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786100413.909521:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960602112:0@lo:501: 10000000:01000000:1.0:1786100413.909543:0:5823:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1786100413.909558:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 00000000c0c00d40/0x5564f2c20ac0a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0a54 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100413.909565:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 00000000c0c00d40/0x5564f2c20ac0a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0a54 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100413.909573:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a3c47abb000 10000000:01000000:1.0:1786100413.909581:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1786100413.909585:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a3c47abb000 10000000:01000000:1.0:1786100413.909587:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1786100413.909589:0:5823:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a3c47abb000 from 1 10000000:01000000:1.0:1786100413.909591:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1786100413.909608:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 00000000891b2c3b/0x5564f2c20ac0a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100413.909615:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 00000000891b2c3b/0x5564f2c20ac0a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100413.909621:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 00000000891b2c3b/0x5564f2c20ac0a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100413.909631:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960602240:0@lo:101: 00000100:00100000:1.0:1786100413.909670:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100413.909681:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 00000000995c90a2 going to sleep for 11 seconds 00000100:00100000:2.0:1786100413.909774:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960602240 00000100:00100000:2.0:1786100413.909778:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960602240 00000100:00100000:2.0:1786100413.909793:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786100413.909797:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dfcff16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+6:5823:x1872861960602240:12345-0@lo:101: 00010000:00010000:2.0:1786100413.909804:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100413.909813:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2e813ed/0x5564f2c20ac0a62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0a5b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100413.909825:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2e813ed/0x5564f2c20ac0a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0a5b expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100413.909833:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2e813ed/0x5564f2c20ac0a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0a5b expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100413.909839:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2e813ed, rc 0) 00000100:00100000:2.0:1786100413.909867:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dfcff16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+7:5823:x1872861960602240:12345-0@lo:101: Request processed in 70us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100413.909872:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786100413.909931:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960602240:0@lo:101: 00010000:00010000:1.0:1786100413.909939:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 00000000891b2c3b/0x5564f2c20ac0a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100413.909945:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 00000000891b2c3b/0x5564f2c20ac0a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100413.909955:0:5823:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1786100413.909967:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 00000000891b2c3b/0x5564f2c20ac0a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100413.909983:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 00000000891b2c3b/0x5564f2c20ac0a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100413.910000:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1786100413.910003:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786100413.910006:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a3c47abb000 10000000:01000000:1.0:1786100413.910009:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1786100413.910011:0:5823:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1786100413.910013:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1786100413.910025:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 0000000011e1592f/0x5564f2c20ac0a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100413.910030:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 0000000011e1592f/0x5564f2c20ac0a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100413.910036:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 0000000011e1592f/0x5564f2c20ac0a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100413.910045:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960602368:0@lo:101: 00000100:00100000:1.0:1786100413.910070:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100413.910086:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 00000000995c90a2 going to sleep for 11 seconds 00000100:00100000:2.0:1786100413.910190:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960602368 00000100:00100000:2.0:1786100413.910194:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960602368 00000100:00100000:2.0:1786100413.910219:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786100413.910223:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000279bf396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+7:5823:x1872861960602368:12345-0@lo:101: 00010000:00010000:2.0:1786100413.910230:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100413.910237:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005beddeb3/0x5564f2c20ac0a70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0a69 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100413.910248:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005beddeb3/0x5564f2c20ac0a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0a69 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100413.910254:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005beddeb3/0x5564f2c20ac0a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0a69 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100413.910260:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005beddeb3, rc 0) 00000100:00100000:2.0:1786100413.910290:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000279bf396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+8:5823:x1872861960602368:12345-0@lo:101: Request processed in 66us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100413.910295:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786100413.910357:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960602368:0@lo:101: 00010000:00010000:1.0:1786100413.910366:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 0000000011e1592f/0x5564f2c20ac0a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0a70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100413.910373:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 0000000011e1592f/0x5564f2c20ac0a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0a70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100413.910407:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960602496:0@lo:501: 00000100:00100000:1.0:1786100413.910430:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100413.910458:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 00000000995c90a2 going to sleep for 11 seconds 00000100:00100000:2.0:1786100413.910509:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960602496 00000100:00100000:2.0:1786100413.910513:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960602496 00000100:00100000:2.0:1786100413.910529:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786100413.910534:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb78389d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+8:5823:x1872861960602496:12345-0@lo:501: 00000100:00100000:2.0:1786100413.910827:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb78389d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+9:5823:x1872861960602496:12345-0@lo:501: Request processed in 292us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100413.910834:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786100413.910941:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960602496:0@lo:501: 00000100:00100000:1.0:1786100413.910968:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960602624:0@lo:503: 00000100:00100000:1.0:1786100413.911074:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100413.911139:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 00000000995c90a2 going to sleep for 11 seconds 00000100:00100000:3.0:1786100413.911175:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960602624 00000100:00100000:3.0:1786100413.911180:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960602624 00000100:00100000:3.0:1786100413.911246:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786100413.911253:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084c0ee63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+9:5823:x1872861960602624:12345-0@lo:503: 00000100:00100000:3.0:1786100413.911403:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084c0ee63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+9:5823:x1872861960602624:12345-0@lo:503: Request processed in 151us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100413.911410:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786100413.911473:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960602624:0@lo:503: 00000100:00100000:1.0:1786100413.911839:0:5866:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:5866:1872861960602752:0@lo:502: 00000100:00100000:1.0:1786100413.911871:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100413.912179:0:5866:0:(client.c:2702:ptlrpc_set_wait()) set 0000000037f05e17 going to sleep for 11 seconds 00000100:00100000:2.0:1786100413.912237:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960602752 00000100:00100000:2.0:1786100413.912241:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960602752 00000100:00100000:2.0:1786100413.912262:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786100413.912267:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001587c838 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+9:5866:x1872861960602752:12345-0@lo:502: 00000100:00100000:2.0:1786100413.912421:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001587c838 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+9:5866:x1872861960602752:12345-0@lo:502: Request processed in 154us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100413.912433:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786100413.912514:0:5866:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:5866:1872861960602752:0@lo:502: 00000020:01000000:1.0:1786100413.912535:0:5866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786100413.912544:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100413.912547:0:5866:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1786100413.912551:0:5866:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1786100413.912554:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786100413.912574:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000058cda2ea) 00000020:00000080:1.0:1786100413.912590:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1786100413.912595:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1786100413.912730:0:5866:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1786100413.912737:0:5866:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac0a7e 00000020:00000080:1.0:1786100413.912957:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1786100413.912961:0:5866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786100413.912964:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100413.912966:0:5866:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1786100413.912968:0:5866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786100413.913063:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100413.913066:0:5866:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1786100413.913071:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786100413.913077:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b87dc3ee) 00000020:00000080:1.0:1786100413.913091:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1786100413.913095:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1786100413.913097:0:5866:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1786100413.913100:0:5866:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1786100413.913105:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1786100413.913148:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fe98c770 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1786100413.913157:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000007a979a08) 00000020:00000080:1.0:1786100413.913164:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1786100413.913208:0:5866:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1786100413.913213:0:5866:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5564f2c20ac0a93 00000020:00000080:1.0:1786100413.913293:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1786100413.913300:0:5866:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1786100413.913303:0:5866:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5564f2c20ac0a9a 00080000:01000000:1.0:1786100413.913308:0:5866:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1786100413.913310:0:5866:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac0aa1 00080000:10000000:1.0:1786100413.913793:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1786100413.914054:0:5866:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1786100413.918395:0:5866:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1786100414.013647:0:5866:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1786100414.013986:0:5866:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1786100414.018320:0:5866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1786100414.018619:0:5866:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1786100414.067643:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001e0c86dc) 00000020:00000080:0.0:1786100414.067681:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1786100414.067777:0:5866:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1786100414.067784:0:5866:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac0aaf 00000020:00000080:2.0:1786100414.068333:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1786100414.069610:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1786100414.112870:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1786100414.140547:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1786100414.160523:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1786100414.190920:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1786100414.221478:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1786100414.240628:0:5866:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5564f2c20ac0ab6 00000020:00000080:2.0:1786100414.244049:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1786100414.244061:0:5866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100414.244071:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100414.244073:0:5866:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1786100414.244076:0:5866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786100414.244080:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100414.244081:0:5866:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786100414.244084:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786100414.244085:0:5866:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1786100414.244088:0:5866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100414.244090:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100414.244091:0:5866:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1786100414.244092:0:5866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786100414.244096:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100414.244098:0:5866:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1786100414.244101:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1786100414.244156:0:5866:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1786100414.244206:0:5866:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000028564caf pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:5866:1872861960602880:0@lo:502: 00000100:00100000:2.0:1786100414.244282:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100414.244326:0:5866:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ead8cd67 going to sleep for 11 seconds 00000100:00100000:2.0:1786100414.244351:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960602880 00000100:00100000:2.0:1786100414.244356:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960602880 00000100:00100000:2.0:1786100414.244387:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786100414.244393:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d0d19d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+9:5866:x1872861960602880:12345-0@lo:502: 00000100:00100000:2.0:1786100414.244684:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d0d19d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+9:5866:x1872861960602880:12345-0@lo:502: Request processed in 290us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100414.244692:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786100414.244748:0:5866:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000028564caf pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:5866:1872861960602880:0@lo:502: 00000020:01000000:2.0:1786100414.244770:0:5866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100414.244774:0:5866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100414.244776:0:5866:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1786100414.244778:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1786100414.245215:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1786100414.245238:0:5823:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1786100414.245255:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 0000000011e1592f/0x5564f2c20ac0a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0a70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.245265:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 0000000011e1592f/0x5564f2c20ac0a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0a70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100414.245272:0:5823:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a3c47abb000 from 1 10000000:01000000:0.0:1786100414.245274:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786100414.245301:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.245307:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.245314:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100414.245328:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000583f025c pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603008:0@lo:101: 00000100:00100000:0.0:1786100414.245370:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100414.245400:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 000000004b15ee3a going to sleep for 11 seconds 00000100:00100000:3.0:1786100414.245459:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960603008 00000100:00100000:3.0:1786100414.245464:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960603008 00000100:00100000:3.0:1786100414.245498:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786100414.245504:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055fcd473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+9:5823:x1872861960603008:12345-0@lo:101: 00010000:00010000:3.0:1786100414.245514:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100414.245524:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001446ca4b/0x5564f2c20ac0ac4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0abd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100414.245542:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001446ca4b/0x5564f2c20ac0ac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0abd expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100414.245560:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001446ca4b/0x5564f2c20ac0ac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0abd expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100414.245568:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001446ca4b, rc 0) 00000100:00100000:3.0:1786100414.245612:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055fcd473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+10:5823:x1872861960603008:12345-0@lo:101: Request processed in 108us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100414.245618:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786100414.245708:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000583f025c pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603008:0@lo:101: 00010000:00010000:1.0:1786100414.245721:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ac4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100414.245728:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0ac4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100414.246292:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603136:0@lo:256: 00000100:00100000:1.0:1786100414.246330:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100414.246363:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039d74938 going to sleep for 11 seconds 00000100:00100000:3.0:1786100414.246555:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960603136 00000100:00100000:3.0:1786100414.246560:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960603136 00000100:00100000:3.0:1786100414.246595:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786100414.246602:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023350dde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+10:5823:x1872861960603136:12345-0@lo:256: 20000000:01000000:3.0:1786100414.246616:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1786100414.246622:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1786100414.246709:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023350dde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+10:5823:x1872861960603136:12345-0@lo:256: Request processed in 108us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100414.246716:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786100414.246846:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603136:0@lo:256: 10000000:01000000:1.0:1786100414.247635:0:5823:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786100414.247791:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ac4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100414.247802:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ac4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100414.247810:0:5823:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c47abb000 from 1 10000000:01000000:1.0:1786100414.247813:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786100414.247839:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100414.247845:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100414.247853:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100414.247868:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603264:0@lo:101: 00000100:00100000:1.0:1786100414.247908:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100414.247998:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039d74938 going to sleep for 11 seconds 00000100:00100000:3.0:1786100414.250406:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960603264 00000100:00100000:3.0:1786100414.250417:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960603264 00000100:00100000:3.0:1786100414.250478:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786100414.250485:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f85eb69a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+10:5823:x1872861960603264:12345-0@lo:101: 00010000:00010000:3.0:1786100414.250501:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100414.250518:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000360eada9/0x5564f2c20ac0ad2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0acb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100414.250541:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000360eada9/0x5564f2c20ac0ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0acb expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100414.250549:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000360eada9/0x5564f2c20ac0ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0acb expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100414.250570:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000360eada9, rc 0) 00000100:00100000:3.0:1786100414.250638:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f85eb69a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:5823:x1872861960603264:12345-0@lo:101: Request processed in 154us (2730us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100414.250645:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786100414.250779:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603264:0@lo:101: 00010000:00010000:1.0:1786100414.250793:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ad2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100414.250803:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0ad2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100414.250858:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603392:0@lo:501: 00000100:00100000:1.0:1786100414.250885:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100414.250924:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039d74938 going to sleep for 11 seconds 00000100:00100000:3.0:1786100414.251076:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960603392 00000100:00100000:3.0:1786100414.251081:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960603392 00000100:00100000:3.0:1786100414.251108:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786100414.251227:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003850a499 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:5823:x1872861960603392:12345-0@lo:501: 00000100:00100000:3.0:1786100414.251737:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003850a499 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:5823:x1872861960603392:12345-0@lo:501: Request processed in 623us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100414.251744:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786100414.251846:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603392:0@lo:501: 00000100:00100000:1.0:1786100414.251875:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603520:0@lo:503: 00000100:00100000:1.0:1786100414.251910:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100414.251988:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039d74938 going to sleep for 11 seconds 00000100:00100000:0.0:1786100414.252281:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960603520 00000100:00100000:0.0:1786100414.252286:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960603520 00000100:00100000:0.0:1786100414.252343:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786100414.252350:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049b14e0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:5823:x1872861960603520:12345-0@lo:503: 00000040:00080000:0.0:1786100414.252381:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786100414.252422:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049b14e0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:5823:x1872861960603520:12345-0@lo:503: Request processed in 73us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100414.252428:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786100414.252487:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603520:0@lo:503: 00000040:00080000:1.0:1786100414.253399:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1786100414.253517:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1786100414.253533:0:5823:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786100414.253556:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ad2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100414.253565:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ad2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100414.253605:0:5823:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1786100414.253608:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a3c47abb000 10000000:01000000:2.0:1786100414.253611:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a3c47abb000 10000000:01000000:2.0:1786100414.253615:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786100414.253620:0:5823:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a3c47abb000 from 1 10000000:01000000:2.0:1786100414.253622:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786100414.253673:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 00000000ce3e7fe5/0x5564f2c20ac0ad9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100414.253680:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 00000000ce3e7fe5/0x5564f2c20ac0ad9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100414.253697:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 00000000ce3e7fe5/0x5564f2c20ac0ad9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100414.253714:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000028564caf pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603648:0@lo:101: 00000100:00100000:2.0:1786100414.253762:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100414.253791:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bb652024 going to sleep for 11 seconds 00000100:00100000:3.0:1786100414.253987:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960603648 00000100:00100000:3.0:1786100414.253993:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960603648 00000100:00100000:3.0:1786100414.254030:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786100414.254036:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc2ddf30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:5823:x1872861960603648:12345-0@lo:101: 00010000:00010000:3.0:1786100414.254044:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100414.254054:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a27e9c12/0x5564f2c20ac0ae0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0ad9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100414.254073:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a27e9c12/0x5564f2c20ac0ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0ad9 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100414.254081:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a27e9c12/0x5564f2c20ac0ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0ad9 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100414.254089:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a27e9c12, rc 0) 00000100:00100000:3.0:1786100414.254243:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc2ddf30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5823:x1872861960603648:12345-0@lo:101: Request processed in 208us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100414.254256:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786100414.254264:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000028564caf pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603648:0@lo:101: 00010000:00010000:2.0:1786100414.254275:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 00000000ce3e7fe5/0x5564f2c20ac0ad9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ae0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100414.254283:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 00000000ce3e7fe5/0x5564f2c20ac0ad9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0ae0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100414.254329:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000028564caf pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603776:0@lo:501: 00000100:00100000:2.0:1786100414.254355:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100414.254370:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bb652024 going to sleep for 11 seconds 00000100:00100000:0.0:1786100414.254417:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960603776 00000100:00100000:0.0:1786100414.254427:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960603776 00000100:00100000:0.0:1786100414.254460:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786100414.254467:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002d0bb70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5823:x1872861960603776:12345-0@lo:501: 00000100:00100000:0.0:1786100414.254866:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002d0bb70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5823:x1872861960603776:12345-0@lo:501: Request processed in 398us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100414.254873:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786100414.254878:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000028564caf pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603776:0@lo:501: 00000100:00100000:1.0:1786100414.254903:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603904:0@lo:503: 00000100:00100000:1.0:1786100414.254941:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100414.254986:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 000000005f46b450 going to sleep for 11 seconds 00000100:00100000:3.0:1786100414.255033:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960603904 00000100:00100000:3.0:1786100414.255038:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960603904 00000100:00100000:3.0:1786100414.255066:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786100414.255073:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2199648 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5823:x1872861960603904:12345-0@lo:503: 00000100:00100000:3.0:1786100414.255358:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2199648 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5823:x1872861960603904:12345-0@lo:503: Request processed in 286us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100414.255364:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786100414.258165:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f789a762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960603904:0@lo:503: 00000100:00100000:3.0:1786100414.262627:0:5871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000830f977c pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:5871:1872861960604032:0@lo:502: 00000100:00100000:3.0:1786100414.262754:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100414.262814:0:5871:0:(client.c:2702:ptlrpc_set_wait()) set 00000000164f8def going to sleep for 11 seconds 00000100:00100000:0.0:1786100414.262824:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960604032 00000100:00100000:0.0:1786100414.262833:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960604032 00000100:00100000:0.0:1786100414.262884:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786100414.262892:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001641c2f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5871:x1872861960604032:12345-0@lo:502: 00000100:00100000:0.0:1786100414.263201:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001641c2f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5871:x1872861960604032:12345-0@lo:502: Request processed in 309us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100414.263209:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786100414.263236:0:5871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000830f977c pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:5871:1872861960604032:0@lo:502: 00000020:01000004:3.0:1786100414.263292:0:5871:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1786100414.263305:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000a9975c76) 00000020:00000080:3.0:1786100414.263321:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1786100414.263492:0:5871:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fe98c770 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786100414.263495:0:5871:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000fe98c770 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786100414.263498:0:5871:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000fe98c770 4 00010000:00080000:3.0:1786100414.263524:0:5871:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000468aed1a@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.153@tcp at head 00010000:00010000:3.0:1786100414.268442:0:5871:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1786100414.268549:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1786100414.268591:0:5871:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786100414.268604:0:5871:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5564f2c20ac0aee 00000100:00080000:3.0:1786100414.268615:0:5871:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786100414.268620:0:5871:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000468aed1a using connection 192.168.206.153@tcp/0@lo 00000100:00100000:3.0:1786100414.268683:0:5871:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000830f977c x1872861960604160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786100414.269832:0:5871:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1786100414.269961:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000830f977c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1872861960604160:0@lo:38: 00000100:00100000:0.0:1786100414.270571:0:5871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000842969cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:5871:1872861960604288:0@lo:502: 00000100:00100000:1.0:1786100414.270611:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100414.270629:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100414.270741:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960604288 00000100:00100000:0.0:1786100414.270747:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960604288 00000100:00100000:0.0:1786100414.270785:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786100414.270841:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960604160 00000100:00100000:3.0:1786100414.270846:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960604160 00000100:00100000:0.0:1786100414.270856:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003aaa069b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5871:x1872861960604288:12345-0@lo:502: 00000100:00100000:3.0:1786100414.270871:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786100414.270877:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f789a762 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1872861960604160:12345-0@lo:38: 00000100:00100000:3.0:1786100414.270925:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f789a762 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1872861960604160:12345-0@lo:38: Request processed in 47us (316us total) trans 0 rc -11/-11 00000100:00100000:3.0:1786100414.270932:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786100414.271062:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786100414.271069:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000468aed1a lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786100414.271073:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1786100414.271076:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000830f977c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1872861960604160:0@lo:38: 00000100:00100000:0.0:1786100414.271455:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003aaa069b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5871:x1872861960604288:12345-0@lo:502: Request processed in 664us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100414.271463:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786100414.271502:0:5871:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e6a052f8 going to sleep for 11 seconds 00000100:00100000:0.0:1786100414.271514:0:5871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000842969cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:5871:1872861960604288:0@lo:502: 00000040:00080000:0.0:1786100414.271536:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1786100414.273809:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1786100414.273844:0:5823:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786100414.273867:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 00000000ce3e7fe5/0x5564f2c20ac0ad9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ae0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100414.273881:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 00000000ce3e7fe5/0x5564f2c20ac0ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ae0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1786100414.273940:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1786100414.273942:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786100414.273943:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786100414.273945:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786100414.273951:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786100414.273953:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786100414.273954:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786100414.273955:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786100414.273956:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786100414.273957:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786100414.273958:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786100414.273959:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786100414.273962:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1786100414.273964:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786100414.273965:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786100414.273966:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786100414.273967:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786100414.273968:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786100414.273978:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786100414.273979:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786100414.273980:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786100414.273981:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786100414.273982:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786100414.273982:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786100414.273983:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786100414.274010:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1786100414.274025:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008e17ca91 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960604416:0@lo:253: 00000100:00100000:2.0:1786100414.274085:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100414.274137:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ead8cd67 going to sleep for 11 seconds 00000100:00100000:0.0:1786100414.274162:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960604416 00000100:00100000:0.0:1786100414.274170:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960604416 00000100:00100000:0.0:1786100414.274239:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786100414.274247:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e890b1ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5823:x1872861960604416:12345-0@lo:253: 20000000:01000000:0.0:1786100414.274273:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1786100414.274286:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1786100414.337329:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786100414.337346:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1786100414.337463:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786100414.337467:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786100414.337485:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100414.337502:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001446ca4b/0x5564f2c20ac0ac4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0abd expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100414.337526:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100414.337556:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001446ca4b/0x5564f2c20ac0ac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0abd expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100414.337568:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001446ca4b/0x5564f2c20ac0ac4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0abd expref: 12 pid: 5838 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100414.337580:0:5859:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000db927bbd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1872861960604544:0@lo:104: 00000100:00100000:1.0:1786100414.337633:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100414.338100:0:5859:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f7acec23 going to sleep for 11 seconds 00000100:00100000:0.0:1786100414.338907:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960604544 00000100:00100000:0.0:1786100414.338922:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960604544 00000100:00100000:0.0:1786100414.339521:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786100414.339534:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa91ebb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:5859:x1872861960604544:12345-0@lo:104: 00010000:00010000:0.0:1786100414.339549:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0ac4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.339641:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786100414.339647:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa91ebb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:5859:x1872861960604544:12345-0@lo:104: Request processed in 118us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100414.339675:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786100414.339821:0:5859:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000db927bbd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1872861960604544:0@lo:104: 00010000:00010000:3.0:1786100414.339844:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340423:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100414.340429:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0ac4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340437:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f4cdbadf already unused, calling callback (000000009d9276aa) 10000000:00010000:0.0:1786100414.340440:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0ac4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340448:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0ac4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100414.340455:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0ac4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100414.340480:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1786100414.340562:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ac4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340569:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100414.340593:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ac4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340600:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: 00000000f4cdbadf/0x5564f2c20ac0abd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ac4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340616:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100414.340617:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100414.340619:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100414.340692:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786100414.340703:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000842969cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960604672:0@lo:103: 00000100:00100000:0.0:1786100414.340747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100414.340817:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960604672 00000100:00100000:0.0:1786100414.340823:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960604672 00010000:00010000:0.0:1786100414.340843:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001446ca4b/0x5564f2c20ac0ac4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0abd expref: 13 pid: 5838 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100414.340866:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786100414.340873:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008172a51d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:3305:x1872861960604672:12345-0@lo:103: 00010000:00010000:0.0:1786100414.340883:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100414.340887:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001446ca4b/0x5564f2c20ac0ac4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0abd expref: 13 pid: 5838 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340897:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001446ca4b/0x5564f2c20ac0ac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0abd expref: 13 pid: 5838 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340916:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001446ca4b/0x5564f2c20ac0ac4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0abd expref: 13 pid: 5838 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340929:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340936:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786100414.340948:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003481651s 00010000:00010000:0.0:1786100414.340951:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340958:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340964:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340989:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.340995:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005c860578 already unused, calling callback (000000003d539495) 00010000:00010000:0.0:1786100414.340998:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.341004:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.341018:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.341037:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100414.341185:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008172a51d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:3305:x1872861960604672:12345-0@lo:103: Request processed in 312us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100414.341193:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1786100414.341298:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.341306:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100414.341311:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005c860578/0x5564f2c20ac0af5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100414.341355:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000842969cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960604672:0@lo:103: 00000100:00100000:0.0:1786100414.351844:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e890b1ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:5823:x1872861960604416:12345-0@lo:253: Request processed in 77590us (77751us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100414.351860:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786100414.351966:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008e17ca91 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:5823:1872861960604416:0@lo:253: 10000000:01000000:2.0:1786100414.352513:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1786100414.352516:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786100414.352518:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786100414.352520:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786100414.352521:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786100414.352523:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786100414.352524:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786100414.352525:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786100414.352526:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786100414.352528:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786100414.352529:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786100414.352530:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786100414.352546:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1786100414.352562:0:5823:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1786100414.363903:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100414.364577:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1786100414.364851:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100414.365615:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1786100414.365902:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100414.366450:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1786100414.367963:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100414.368386:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1786100414.368599:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100414.369314:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1786100414.369536:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100414.369954:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1786100414.418353:0:5823:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1786100414.442454:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1786100414.442729:0:5877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1786100414.443173:0:5876:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1786100414.443178:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1786100414.446149:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1786100414.446478:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1786100414.447057:0:5823:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1786100414.447073:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1786100414.450102:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786100414.452439:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1786100414.453436:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1786100414.453480:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1786100414.453771:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1786100414.455138:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1786100414.457326:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1786100414.457481:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1786100414.457683:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1786100414.457851:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1786100414.458028:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1786100414.458193:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1786100414.459803:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1786100414.459950:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1786100414.460804:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1786100414.460947:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1786100414.461131:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1786100414.461575:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1786100414.461798:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1786100414.461964:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1786100414.462418:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1786100414.462561:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1786100414.462961:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1786100414.467566:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1786100414.467796:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1786100414.467991:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1786100414.473840:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1786100414.475431:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1786100414.475606:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1786100414.475774:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1786100414.475935:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1786100414.476084:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1786100414.476261:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1786100414.476403:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1786100414.476535:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1786100414.476704:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1786100414.476855:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1786100414.477025:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1786100414.477221:0:5823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1786100414.497367:0:5877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1786100414.547720:0:5823:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1786100414.547757:0:5823:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa94fc1d8f988 00100000:10000000:3.0:1786100414.547765:0:5823:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1786100414.548601:0:5823:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1786100414.548615:0:5823:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.153@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1786100414.548628:0:5823:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1786100414.551372:0:5823:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1786100414.584343:0:5877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1786100414.584423:0:5877:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1786100414.584427:0:5877:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1786100414.630767:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100415.654569:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100416.676999:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100417.703283:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100418.725609:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786100418.765178:0:6119:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1786100419.493140:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1786100419.493155:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786100419.493159:0:467:0:(import.c:65:import_set_state_nolock()) 00000000468aed1a lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786100419.493177:0:467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000468aed1a using connection 192.168.206.153@tcp/0@lo 00000100:00100000:0.0:1786100419.493205:0:467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d1344382 x1872861960604928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786100419.493267:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d1344382 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1872861960604928:0@lo:38: 00000100:00100000:0.0:1786100419.493355:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100419.493453:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960604928 00000100:00100000:0.0:1786100419.493462:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960604928 00000100:00100000:0.0:1786100419.493504:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786100419.493512:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee506b1f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1872861960604928:12345-0@lo:38: 00010000:00080000:0.0:1786100419.493543:0:5845:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:0.0:1786100419.493592:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5564f2c20ac0afc 00000004:00100000:0.0:1786100419.493639:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786100419.493825:0:5845:0:(import.c:65:import_set_state_nolock()) 0000000094671ed6 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786100419.493890:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee506b1f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1872861960604928:12345-0@lo:38: Request processed in 377us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100419.493898:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1786100419.493997:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d1344382 x1872861960604928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786100429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786100419.494015:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1786100419.494029:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1786100419.494034:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786100419.494037:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000468aed1a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786100419.494042:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d1344382 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1872861960604928:0@lo:38: 00000100:00100000:2.0:1786100419.494312:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000842969cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960604800:0@lo:400: 00000100:00100000:2.0:1786100419.494360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100419.494892:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960604800 00000100:00100000:0.0:1786100419.494900:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960604800 00000100:00100000:0.0:1786100419.495059:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786100419.495068:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e46ad70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:3307:x1872861960604800:12345-0@lo:400: 00000100:00100000:0.0:1786100419.495143:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e46ad70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:3307:x1872861960604800:12345-0@lo:400: Request processed in 77us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100419.495157:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786100419.495293:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000842969cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960604800:0@lo:400: 00010000:00010000:1.0:1786100419.750828:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100420.774568:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100421.798300:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100422.821481:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786100423.382645:0:6321:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe58e9fbe0 20000000:00000080:2.0:1786100423.382684:0:6321:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a3c75903800 uarg=0000000000000000 20000000:01000000:2.0:1786100423.382718:0:6321:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1786100423.382724:0:6321:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1786100423.382729:0:6321:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1786100423.382973:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1786100423.382984:0:6321:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1786100423.390171:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786100423.390408:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1786100423.390460:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1786100423.390507:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1786100423.390523:0:6321:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1786100423.390539:0:6321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100423.390555:0:6321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000360eada9/0x5564f2c20ac0ad2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0acb expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100423.391364:0:6321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100423.391404:0:6321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000360eada9/0x5564f2c20ac0ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0acb expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100423.391417:0:6321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000360eada9/0x5564f2c20ac0ad2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0acb expref: 10 pid: 5837 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100423.391431:0:6321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008e17ca91 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1872861960605056:0@lo:104: 00000100:00100000:2.0:1786100423.391491:0:6321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100423.391560:0:6321:0:(client.c:2702:ptlrpc_set_wait()) set 000000008ae98204 going to sleep for 11 seconds 00000100:00100000:0.0:1786100423.393292:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960605056 00000100:00100000:0.0:1786100423.393304:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960605056 00000100:00100000:0.0:1786100423.393374:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786100423.393383:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c08ae0f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:6321:x1872861960605056:12345-0@lo:104: 00010000:00010000:0.0:1786100423.393398:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0ad2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100423.393484:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786100423.393490:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c08ae0f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:6321:x1872861960605056:12345-0@lo:104: Request processed in 109us (2000us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100423.393497:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1786100423.393531:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100423.393536:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0ad2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100423.393544:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e4a4ce01 already unused, calling callback (000000009d9276aa) 10000000:00010000:0.0:1786100423.393547:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0ad2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100423.393555:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0ad2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100423.393561:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0ad2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100423.393566:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786100423.393600:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ad2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100423.393623:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100423.393641:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ad2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100423.393646:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: 00000000e4a4ce01/0x5564f2c20ac0acb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ad2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100423.393687:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100423.393689:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100423.393691:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786100423.393700:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1786100423.393704:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a3c47abb000 from 3 10000000:01000000:0.0:1786100423.393707:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786100423.393728:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 00000000da8bedfc/0x5564f2c20ac0b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100423.393735:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 00000000da8bedfc/0x5564f2c20ac0b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100423.393743:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 00000000da8bedfc/0x5564f2c20ac0b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100423.393758:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006eb5c920 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960605312:0@lo:101: 00000100:00100000:0.0:1786100423.393795:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100423.393823:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c86a06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100423.393838:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d1344382 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960605184:0@lo:103: 00000100:00100000:0.0:1786100423.393863:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100423.393894:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960605312 00000100:00100000:0.0:1786100423.393898:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960605312 00000100:00100000:3.0:1786100423.394083:0:6321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008e17ca91 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1872861960605056:0@lo:104: 00010000:00010000:3.0:1786100423.394103:0:6321:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100423.394457:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786100423.394467:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc64c88b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:5840:x1872861960605312:12345-0@lo:101: 00010000:00010000:0.0:1786100423.394481:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100423.394493:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a1a1b845/0x5564f2c20ac0b11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0b0a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100423.394521:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a1a1b845/0x5564f2c20ac0b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0b0a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100423.394531:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a1a1b845/0x5564f2c20ac0b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0b0a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100423.394538:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a1a1b845, rc 0) 00000100:00100000:0.0:1786100423.394574:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc64c88b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5840:x1872861960605312:12345-0@lo:101: Request processed in 110us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100423.394580:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786100423.397489:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960605184 00000100:00100000:1.0:1786100423.397501:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960605184 00010000:00010000:1.0:1786100423.397537:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000360eada9/0x5564f2c20ac0ad2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0acb expref: 12 pid: 5837 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100423.397579:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786100423.397587:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3e2dcb0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:3308:x1872861960605184:12345-0@lo:103: 00010000:00010000:1.0:1786100423.397601:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100423.397617:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000360eada9/0x5564f2c20ac0ad2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0acb expref: 12 pid: 5837 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100423.397629:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000360eada9/0x5564f2c20ac0ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0acb expref: 12 pid: 5837 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100423.398266:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006eb5c920 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960605312:0@lo:101: 00010000:00010000:0.0:1786100423.398286:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 00000000da8bedfc/0x5564f2c20ac0b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100423.398296:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 00000000da8bedfc/0x5564f2c20ac0b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0b11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100423.398359:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006eb5c920 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960605440:0@lo:256: 00010000:00010000:1.0:1786100423.398374:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000360eada9/0x5564f2c20ac0ad2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0acb expref: 12 pid: 5837 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100423.398390:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100423.398395:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100423.398405:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100423.398411:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100423.398417:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100423.398417:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786100423.398422:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100423.398428:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008907a1ec already unused, calling callback (000000003d539495) 00010000:00010000:1.0:1786100423.398431:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100423.398438:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100423.398464:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100423.398474:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786100423.398498:0:6321:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100423.398508:0:6321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100423.398515:0:6321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008907a1ec/0x5564f2c20ac0b03 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100423.398520:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3e2dcb0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:3308:x1872861960605184:12345-0@lo:103: Request processed in 932us (4655us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100423.398532:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786100423.398587:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d1344382 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960605184:0@lo:103: 00000100:00100000:0.0:1786100423.398839:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c86a06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100423.401289:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960605440 00000100:00100000:2.0:1786100423.401301:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960605440 00000100:00100000:2.0:1786100423.401357:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786100423.401366:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b76582a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:5840:x1872861960605440:12345-0@lo:256: 20000000:01000000:2.0:1786100423.401389:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1786100423.401405:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786100423.401408:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1786100423.401538:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b76582a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:5840:x1872861960605440:12345-0@lo:256: Request processed in 173us (3121us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100423.401546:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786100423.401593:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006eb5c920 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960605440:0@lo:256: 10000000:01000000:2.0:1786100423.401640:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786100423.401671:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: 00000000da8bedfc/0x5564f2c20ac0b0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100423.401681:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: 00000000da8bedfc/0x5564f2c20ac0b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100423.401696:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786100423.401698:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c47abb000 from 1 10000000:01000000:2.0:1786100423.401701:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786100423.401729:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: 00000000d4bef1e1/0x5564f2c20ac0b18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100423.401735:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: 00000000d4bef1e1/0x5564f2c20ac0b18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100423.401744:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: 00000000d4bef1e1/0x5564f2c20ac0b18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100423.401761:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067b9ee5a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960605568:0@lo:101: 00000100:00100000:2.0:1786100423.401798:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100423.401840:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fbf0c027 going to sleep for 11 seconds 00000100:00100000:2.0:1786100423.401898:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960605568 00000100:00100000:2.0:1786100423.401902:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960605568 00000100:00100000:2.0:1786100423.401946:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786100423.401953:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086d58d4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:5840:x1872861960605568:12345-0@lo:101: 00010000:00010000:2.0:1786100423.401962:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100423.401974:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ffef36a1/0x5564f2c20ac0b1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0b18 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100423.401993:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ffef36a1/0x5564f2c20ac0b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0b18 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100423.402003:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ffef36a1/0x5564f2c20ac0b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0b18 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100423.402022:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ffef36a1, rc 0) 00000100:00100000:2.0:1786100423.402058:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086d58d4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5840:x1872861960605568:12345-0@lo:101: Request processed in 106us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100423.402079:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786100423.402118:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067b9ee5a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960605568:0@lo:101: 00010000:00010000:2.0:1786100423.402127:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: 00000000d4bef1e1/0x5564f2c20ac0b18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100423.402136:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: 00000000d4bef1e1/0x5564f2c20ac0b18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0b1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100423.402187:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067b9ee5a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960605696:0@lo:501: 00000100:00100000:2.0:1786100423.402216:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100423.402231:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fbf0c027 going to sleep for 11 seconds 00000100:00100000:2.0:1786100423.402244:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960605696 00000100:00100000:2.0:1786100423.402248:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960605696 00000100:00100000:2.0:1786100423.402278:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786100423.402286:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d07b4c42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5840:x1872861960605696:12345-0@lo:501: 00000100:00100000:2.0:1786100423.402531:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d07b4c42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5840:x1872861960605696:12345-0@lo:501: Request processed in 247us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100423.402539:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786100423.402568:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067b9ee5a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960605696:0@lo:501: 00000100:00100000:2.0:1786100423.402592:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067b9ee5a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960605824:0@lo:503: 00000100:00100000:2.0:1786100423.402627:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100423.402638:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fbf0c027 going to sleep for 11 seconds 00000100:00100000:2.0:1786100423.402674:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960605824 00000100:00100000:2.0:1786100423.402678:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960605824 00000100:00100000:2.0:1786100423.402694:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786100423.402699:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000320b0fdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5840:x1872861960605824:12345-0@lo:503: 00000100:00100000:2.0:1786100423.402811:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000320b0fdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5840:x1872861960605824:12345-0@lo:503: Request processed in 109us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100423.402818:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786100423.402856:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067b9ee5a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960605824:0@lo:503: 00000100:00100000:2.0:1786100423.403786:0:6322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067b9ee5a pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:6322:1872861960605952:0@lo:502: 00000100:00100000:2.0:1786100423.403845:0:6322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100423.403874:0:6322:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef5464ba going to sleep for 11 seconds 00000100:00100000:3.0:1786100423.404129:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960605952 00000100:00100000:3.0:1786100423.404136:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960605952 00000100:00100000:3.0:1786100423.404169:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786100423.404177:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a307544 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6322:x1872861960605952:12345-0@lo:502: 00000100:00100000:3.0:1786100423.404332:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a307544 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6322:x1872861960605952:12345-0@lo:502: Request processed in 156us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100423.404340:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786100423.404367:0:6322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067b9ee5a pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:6322:1872861960605952:0@lo:502: 00000020:01000000:2.0:1786100423.404399:0:6322:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786100423.404407:0:6322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100423.404410:0:6322:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1786100423.404415:0:6322:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a3c47abb000 00000020:00000080:2.0:1786100423.404417:0:6322:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786100423.404453:0:6322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:6322:1872861960606080:0@lo:502: 00000100:00100000:2.0:1786100423.404488:0:6322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100423.404543:0:6322:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c50c5af00 going to sleep for 11 seconds 00000100:00100000:0.0:1786100423.404580:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960606080 00000100:00100000:0.0:1786100423.404585:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960606080 00000100:00100000:0.0:1786100423.404669:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786100423.404684:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6322:x1872861960606080:12345-0@lo:502: 00000100:00100000:0.0:1786100423.404809:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6322:x1872861960606080:12345-0@lo:502: Request processed in 126us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100423.404817:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786100423.404879:0:6322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:6322:1872861960606080:0@lo:502: 00000020:01000000:1.0:1786100423.404899:0:6322:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786100423.404903:0:6322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100423.404905:0:6322:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1786100423.404908:0:6322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1786100423.405210:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1786100423.405228:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786100423.405237:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac0b18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100423.405249:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac0b18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100423.847115:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100424.619074:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960606336:0@lo:400: 00000100:00100000:1.0:1786100424.619141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100424.619194:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786100424.619200:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960606208:0@lo:400: 00000100:00100000:1.0:1786100424.619226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100424.619266:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960606336 00000100:00100000:1.0:1786100424.619273:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960606336 00000100:00100000:1.0:1786100424.619315:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786100424.619324:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960606336:12345-0@lo:400: 00000100:00100000:1.0:1786100424.619372:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960606336:12345-0@lo:400: Request processed in 49us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100424.619379:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786100424.619417:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960606208 00000100:00100000:1.0:1786100424.619425:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960606208 00000100:00100000:1.0:1786100424.619452:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786100424.619458:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:3306:x1872861960606208:12345-0@lo:400: 00000100:00100000:1.0:1786100424.619488:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:3306:x1872861960606208:12345-0@lo:400: Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100424.619493:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786100424.619532:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960606208:0@lo:400: 00010000:00080000:1.0:1786100424.619545:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a3c745b0000 x1872861960606336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100424.619556:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960606336:0@lo:400: 00010000:00010000:0.0:1786100424.870243:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100425.897762:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100426.920748:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100427.941058:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100428.966218:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1786100429.165197:0:6681:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1786100429.165201:0:6681:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1786100429.165339:0:6681:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a3c6e163000 00000020:01000004:1.0:1786100429.165353:0:6681:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1786100429.165365:0:6681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1786100429.165379:0:6681:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a3c6e19cd40) 00000020:00000080:1.0:1786100429.165394:0:6681:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1786100429.203364:0:6681:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1786100429.203614:0:6681:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1786100429.224433:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1786100429.229247:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786100429.229275:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1786100429.229325:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786100429.229347:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1786100429.229980:0:6681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1786100429.229990:0:6681:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786100429.230002:0:6681:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5564f2c20ac0b2d 00000020:01000004:3.0:1786100429.230009:0:6681:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1786100429.230036:0:6681:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1786100429.230039:0:6681:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1786100429.230044:0:6681:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1786100429.230048:0:6681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1786100429.230059:0:6681:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a3c472dcd40) 00000020:00000080:3.0:1786100429.230069:0:6681:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1786100429.231263:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786100429.231404:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1786100429.231411:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1786100429.232190:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1786100429.232199:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1786100429.235790:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1786100429.235802:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1786100429.237443:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786100429.237612:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1786100429.237619:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1786100429.238296:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1786100429.238302:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1786100429.270267:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786100429.270485:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1786100429.270492:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1786100429.272626:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1786100429.272743:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1786100429.274399:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1786100429.274410:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1786100429.277442:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786100429.277628:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1786100429.277635:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1786100429.278507:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1786100429.278516:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1786100429.362072:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786100429.362261:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1786100429.362268:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1786100429.363445:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1786100429.363455:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1786100429.363838:0:6681:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1786100429.363865:0:6681:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1786100429.363871:0:6681:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1786100429.399322:0:6681:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1786100429.399357:0:6681:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.153@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1786100429.399362:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1786100429.399363:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786100429.399365:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786100429.399366:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786100429.399367:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786100429.399368:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786100429.399374:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786100429.399375:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1786100429.399376:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1786100429.399378:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786100429.399379:0:6681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1786100429.399383:0:6681:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1786100429.399385:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786100429.399386:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786100429.399387:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786100429.399388:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786100429.399389:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786100429.399390:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786100429.399391:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786100429.399392:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1786100429.399393:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1786100429.399394:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786100429.399395:0:6681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1786100429.399417:0:6681:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1786100429.399435:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960606464:0@lo:253: 00000100:00100000:0.0:1786100429.399500:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100429.400169:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7ce9c900 going to sleep for 11 seconds 00000100:00100000:3.0:1786100429.402196:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960606464 00000100:00100000:3.0:1786100429.402208:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960606464 00000100:00100000:3.0:1786100429.403970:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786100429.403987:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6681:x1872861960606464:12345-0@lo:253: 20000000:01000000:3.0:1786100429.404023:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1786100429.404027:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1786100429.404032:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1786100429.404035:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1786100429.406757:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786100429.406993:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1786100429.407007:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1786100429.407043:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1786100429.407051:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1786100429.407079:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1786100429.407125:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1786100429.407561:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1786100429.407580:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.153@tcp 20000000:01000000:3.0:1786100429.407582:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.153@tcp (null) (null) (null) 00000040:00080000:3.0:1786100429.407615:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1786100429.407624:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1786100429.407777:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1786100429.407786:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.153@tcp (null) (null) 00000040:00080000:3.0:1786100429.407820:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1786100429.407839:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1786100429.407874:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1786100429.407936:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1786100429.410015:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1786100429.410040:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.153@tcp 20000000:01000000:3.0:1786100429.410042:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.153@tcp (null) (null) (null) 00000040:00080000:3.0:1786100429.410075:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1786100429.410082:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1786100429.410110:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1786100429.410118:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.153@tcp (null) (null) 00000040:00080000:3.0:1786100429.410158:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1786100429.410168:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1786100429.410198:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1786100429.410230:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1786100429.410246:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1786100429.410249:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1786100429.410252:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1786100429.410263:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1786100429.410265:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1786100429.410296:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1786100429.410299:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1786100429.415312:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1786100429.415628:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1786100429.415998:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1786100429.416072:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1786100429.416086:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1786100429.416090:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1786100429.421966:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1786100429.422072:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1786100429.422134:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1786100429.422898:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1786100429.422951:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1786100429.423040:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1786100429.423055:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1786100429.423057:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1786100429.423699:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1786100429.423758:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1786100429.423808:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1786100429.424140:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1786100429.424185:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1786100429.424234:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1786100429.424251:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1786100429.424253:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1786100429.424262:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1786100429.424280:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.424298:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0a54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0a4d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.424306:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0a70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0a69 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.424312:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c41510c00/0x5564f2c20ac0ae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0ad9 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.424319:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.424356:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c41510c00/0x5564f2c20ac0ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0ad9 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.424370:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c41510c00/0x5564f2c20ac0ae0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0ad9 expref: 12 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100429.424383:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960606592:0@lo:104: 00000100:00100000:3.0:1786100429.424441:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786100429.424502:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0a69 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.424511:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0a70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0a69 expref: 12 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100429.424530:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960606720:0@lo:104: 00000100:00100000:3.0:1786100429.424553:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786100429.424579:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0a4d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.424587:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0a54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0a4d expref: 12 pid: 5837 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100429.424595:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960606848:0@lo:104: 00000100:00100000:3.0:1786100429.424613:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100429.424622:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583d4000 going to sleep for 11 seconds 00000100:00100000:0.0:1786100429.424711:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960606592 00000100:00100000:0.0:1786100429.424718:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960606592 00000100:00100000:0.0:1786100429.424751:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960606720 00000100:00100000:0.0:1786100429.424754:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960606720 00000100:00100000:0.0:1786100429.424764:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960606848 00000100:00100000:0.0:1786100429.424767:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960606848 00000100:00100000:0.0:1786100429.424778:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786100429.424787:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:5838:x1872861960606592:12345-0@lo:104: 00010000:00010000:0.0:1786100429.424798:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0ae0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.424848:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786100429.424853:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:5838:x1872861960606592:12345-0@lo:104: Request processed in 68us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100429.424869:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786100429.424900:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786100429.424906:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:5838:x1872861960606720:12345-0@lo:104: 00010000:00010000:0.0:1786100429.424914:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c62386600/0x5564f2c20ac0a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0a70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.424948:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1786100429.424953:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:5838:x1872861960606720:12345-0@lo:104: Request processed in 48us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100429.424958:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786100429.424968:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786100429.424974:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:5838:x1872861960606848:12345-0@lo:104: 00010000:00010000:0.0:1786100429.424980:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0a54 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425003:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1786100429.425007:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:5838:x1872861960606848:12345-0@lo:104: Request processed in 35us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100429.425012:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1786100429.425027:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786100429.425033:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0ae0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425040:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f200 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100429.425044:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0ae0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425062:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0ae0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100429.425069:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0ae0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100429.425074:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786100429.425099:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0ad9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ae0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425106:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100429.425124:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0ad9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ae0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425132:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0ad9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ae0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425145:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786100429.425148:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c62386600/0x5564f2c20ac0a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0a70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425154:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386600 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100429.425157:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62386600/0x5564f2c20ac0a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0a70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425164:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c62386600/0x5564f2c20ac0a69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0a70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100429.425171:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62386600/0x5564f2c20ac0a69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0a70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100429.425182:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786100429.425195:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c62386600/0x5564f2c20ac0a69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0a70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425201:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100429.425207:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c62386600/0x5564f2c20ac0a69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0a70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425213:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c62386600/0x5564f2c20ac0a69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0a70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425223:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100429.425226:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0a54 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425232:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fc00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100429.425235:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0a54 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425241:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0a54 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100429.425246:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0a54 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100429.425250:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786100429.425261:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0a4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0a54 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425266:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100429.425285:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0a4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0a54 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425292:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0a4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0a54 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425307:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100429.425309:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100429.425311:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100429.425316:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100429.425328:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960606976:0@lo:103: 00000100:00100000:0.0:1786100429.425356:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100429.425379:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786100429.425385:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960607104:0@lo:103: 00000100:00100000:0.0:1786100429.425406:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100429.425432:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960607232:0@lo:103: 00000100:00100000:0.0:1786100429.425453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100429.425539:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960606976 00000100:00100000:0.0:1786100429.425544:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960606976 00010000:00010000:0.0:1786100429.425561:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c41510c00/0x5564f2c20ac0ae0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0ad9 expref: 13 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100429.425576:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960607104 00000100:00100000:0.0:1786100429.425579:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960607104 00010000:00010000:0.0:1786100429.425587:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0a70 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0a69 expref: 14 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100429.425596:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960607232 00000100:00100000:0.0:1786100429.425598:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960607232 00010000:00010000:0.0:1786100429.425605:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0a54 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0a4d expref: 15 pid: 5837 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100429.425625:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786100429.425630:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:3307:x1872861960606976:12345-0@lo:103: 00010000:00010000:0.0:1786100429.425640:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100429.425646:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c41510c00/0x5564f2c20ac0ae0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0ad9 expref: 15 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425681:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c41510c00/0x5564f2c20ac0ae0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0ad9 expref: 15 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425695:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100429.425725:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:3307:x1872861960606976:12345-0@lo:103: Request processed in 93us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100429.425731:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786100429.425745:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786100429.425751:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:3307:x1872861960607104:12345-0@lo:103: 00010000:00010000:0.0:1786100429.425758:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100429.425762:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0a70 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0a69 expref: 14 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425770:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0a70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0a69 expref: 14 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425779:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100429.425798:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:3307:x1872861960607104:12345-0@lo:103: Request processed in 47us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100429.425804:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786100429.425814:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786100429.425825:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:3305:x1872861960607232:12345-0@lo:103: 00010000:00010000:0.0:1786100429.425833:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100429.425837:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0a54 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0a4d expref: 13 pid: 5837 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425847:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0a54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0a4d expref: 13 pid: 5837 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425858:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425865:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425877:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425897:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425904:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425911:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425916:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c41510000 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100429.425920:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425927:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425942:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.425950:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100429.425976:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:3305:x1872861960607232:12345-0@lo:103: Request processed in 151us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100429.425983:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786100429.426014:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960607232:0@lo:103: 00000100:00100000:0.0:1786100429.426035:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960607104:0@lo:103: 00000100:00100000:0.0:1786100429.426042:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960606976:0@lo:103: 00010000:00010000:3.0:1786100429.426211:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c41510c00/0x5564f2c20ac0ae0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0ad9 expref: 12 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100429.426223:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960606592:0@lo:104: 00010000:00010000:3.0:1786100429.426233:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0a70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0a69 expref: 11 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100429.426241:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960606720:0@lo:104: 00010000:00010000:3.0:1786100429.426248:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0a54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0a4d expref: 10 pid: 5837 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100429.426256:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960606848:0@lo:104: 00010000:00010000:3.0:1786100429.426272:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.426281:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.426293:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.426299:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b3b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1786100429.426312:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1786100429.468367:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+9:6681:x1872861960606464:12345-0@lo:253: Request processed in 64378us (68858us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100429.468383:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786100429.468569:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960606464:0@lo:253: 10000000:01000000:0.0:1786100429.468582:0:6681:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1786100429.468585:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786100429.468587:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786100429.468588:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786100429.468590:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1786100429.468591:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786100429.468592:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786100429.468594:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786100429.468595:0:6681:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1786100429.468597:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786100429.468598:0:6681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1786100429.468756:0:6681:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a3c6e163000 from lustre-OST0000 10000000:01000000:2.0:1786100429.468780:0:6681:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1786100429.468783:0:6681:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1786100429.468789:0:6681:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a3c44f34d40 local copy 10000000:01000000:2.0:1786100429.468793:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786100429.468828:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.468839:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.468848:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100429.468866:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960607360:0@lo:101: 00000100:00100000:2.0:1786100429.468966:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100429.469084:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c60253240 going to sleep for 11 seconds 00000100:00100000:0.0:1786100429.469147:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960607360 00000100:00100000:0.0:1786100429.469153:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960607360 00000100:00100000:0.0:1786100429.469185:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786100429.469193:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+9:6681:x1872861960607360:12345-0@lo:101: 00010000:00010000:0.0:1786100429.469204:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100429.469216:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbba200/0x5564f2c20ac0b49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0b42 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.469249:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbba200/0x5564f2c20ac0b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0b42 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.469258:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbba200/0x5564f2c20ac0b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0b42 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.469267:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbba200, rc 0) 00000100:00100000:0.0:1786100429.469307:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+10:6681:x1872861960607360:12345-0@lo:101: Request processed in 115us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100429.469312:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786100429.469387:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960607360:0@lo:101: 00010000:00010000:2.0:1786100429.469400:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5564f2c20ac0b49 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.469408:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5564f2c20ac0b49 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100429.469493:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960607488:0@lo:501: 00000100:00100000:2.0:1786100429.469518:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100429.469540:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c60253240 going to sleep for 11 seconds 00000100:00100000:3.0:1786100429.469590:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960607488 00000100:00100000:3.0:1786100429.469595:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960607488 00000100:00100000:3.0:1786100429.469622:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786100429.469628:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+10:6681:x1872861960607488:12345-0@lo:501: 00000100:00100000:3.0:1786100429.469835:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+10:6681:x1872861960607488:12345-0@lo:501: Request processed in 206us (315us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786100429.469843:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786100429.470020:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960607488:0@lo:501: 10000000:01000000:2.0:1786100429.470034:0:6681:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1786100429.470064:0:6681:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1786100429.470069:0:6681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5564f2c20ac0b49 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.470077:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5564f2c20ac0b49 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.470085:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5564f2c20ac0b49 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.470105:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1786100429.470122:0:6681:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a3c6e163000 10000000:01000000:2.0:1786100429.470126:0:6681:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1786100429.470131:0:6681:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a3c44f34d40 10000000:01000000:2.0:1786100429.470133:0:6681:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1786100429.470137:0:6681:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a3c44f34d40 from 1 10000000:01000000:2.0:1786100429.470139:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1786100429.470155:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac0b50 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.470163:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac0b50 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.470171:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac0b50 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100429.470183:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960607616:0@lo:101: 00000100:00100000:2.0:1786100429.470210:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100429.470267:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960607616 00000100:00100000:3.0:1786100429.470271:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960607616 00000100:00100000:3.0:1786100429.470296:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1786100429.470302:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+10:6681:x1872861960607616:12345-0@lo:101: 00010000:00010000:3.0:1786100429.470310:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100429.470321:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b57 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0b50 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.470335:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b57 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0b50 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.470343:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b57 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0b50 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.470362:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c41510000, rc 0) 00000100:00100000:3.0:1786100429.470387:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:6681:x1872861960607616:12345-0@lo:101: Request processed in 85us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100429.470392:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1786100429.470461:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100429.470468:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5564f2c20ac0b49 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.470475:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f000 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100429.470478:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5564f2c20ac0b49 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.470486:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5564f2c20ac0b49 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100429.470493:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5564f2c20ac0b49 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100429.470498:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786100429.470516:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5564f2c20ac0b49 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.470522:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100429.470553:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5564f2c20ac0b49 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.470560:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f000/0x5564f2c20ac0b42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5564f2c20ac0b49 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.470575:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100429.470577:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100429.470579:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100429.470586:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786100429.470595:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960607744:0@lo:103: 00000100:00100000:0.0:1786100429.470622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100429.470818:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960607744 00000100:00100000:1.0:1786100429.470822:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960607744 00000100:00100000:1.0:1786100429.470859:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786100429.470867:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:3305:x1872861960607744:12345-0@lo:103: 00010000:00010000:1.0:1786100429.470876:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100429.470900:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbba200/0x5564f2c20ac0b49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0b42 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.470912:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100429.470939:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+10:3305:x1872861960607744:12345-0@lo:103: Request processed in 72us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100429.470945:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786100429.471072:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c60253540 going to sleep for 11 seconds 00000100:00100000:2.0:1786100429.471087:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960607616:0@lo:101: 00010000:00010000:2.0:1786100429.471108:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac0b50 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b57 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.471115:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac0b50 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0b57 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100429.471130:0:6681:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1786100429.471182:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac0b50 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b57 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.471190:0:6681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac0b50 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b57 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100429.471196:0:6681:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1786100429.471200:0:6681:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786100429.471205:0:6681:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1786100429.471207:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1786100429.471221:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.471228:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.471235:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100429.471246:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960607872:0@lo:101: 00000100:00100000:2.0:1786100429.471271:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100429.471295:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c60253540 going to sleep for 11 seconds 00000100:00100000:1.0:1786100429.471339:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960607872 00000100:00100000:1.0:1786100429.471343:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960607872 00000100:00100000:0.0:1786100429.471441:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960607744:0@lo:103: 00000100:00100000:1.0:1786100429.471482:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786100429.471489:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+10:6681:x1872861960607872:12345-0@lo:101: 00010000:00010000:1.0:1786100429.471498:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100429.471507:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0b65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0b5e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.471522:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0b5e expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.471531:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0b5e expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.471544:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62387c00, rc 0) 00000100:00100000:1.0:1786100429.471582:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:6681:x1872861960607872:12345-0@lo:101: Request processed in 94us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100429.471588:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1786100429.471645:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960607872:0@lo:101: 00010000:00010000:0.0:1786100429.471674:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b65 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.471681:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0b65 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100429.471752:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608000:0@lo:501: 00000100:00100000:0.0:1786100429.471776:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100429.471960:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7ce9c480 going to sleep for 11 seconds 00000100:00100000:2.0:1786100429.472323:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960608000 00000100:00100000:2.0:1786100429.472335:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960608000 00000100:00100000:2.0:1786100429.472358:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786100429.472364:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:6681:x1872861960608000:12345-0@lo:501: 00000100:00100000:2.0:1786100429.472582:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:6681:x1872861960608000:12345-0@lo:501: Request processed in 217us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100429.472589:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786100429.472695:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608000:0@lo:501: 00000100:00100000:0.0:1786100429.472726:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608128:0@lo:503: 00000100:00100000:0.0:1786100429.472763:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100429.472781:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7ce9c480 going to sleep for 11 seconds 00000100:00100000:2.0:1786100429.472836:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960608128 00000100:00100000:2.0:1786100429.472840:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960608128 00000100:00100000:2.0:1786100429.472857:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1786100429.472863:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:6681:x1872861960608128:12345-0@lo:503: 00000100:00100000:2.0:1786100429.473015:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:6681:x1872861960608128:12345-0@lo:503: Request processed in 151us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100429.473022:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786100429.473141:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608128:0@lo:503: 00000040:00080000:0.0:1786100429.473374:0:6681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786100429.473437:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608256:0@lo:502: 00000100:00100000:0.0:1786100429.473470:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100429.473492:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7ce9c480 going to sleep for 11 seconds 00000100:00100000:2.0:1786100429.473545:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960608256 00000100:00100000:2.0:1786100429.473549:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960608256 00000100:00100000:2.0:1786100429.473568:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1786100429.473574:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:6681:x1872861960608256:12345-0@lo:502: 00000100:00100000:2.0:1786100429.473735:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:6681:x1872861960608256:12345-0@lo:502: Request processed in 160us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100429.473742:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786100429.473834:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608256:0@lo:502: 00000040:00080000:0.0:1786100429.474075:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1786100429.474118:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1786100429.474148:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1786100429.474201:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1786100429.474237:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1786100429.474266:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1786100429.474288:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608384:0@lo:502: 00000100:00100000:0.0:1786100429.474323:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100429.474345:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7ce9c480 going to sleep for 11 seconds 00000100:00100000:2.0:1786100429.474458:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960608384 00000100:00100000:2.0:1786100429.474463:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960608384 00000100:00100000:2.0:1786100429.474485:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1786100429.474491:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:6681:x1872861960608384:12345-0@lo:502: 00000100:00100000:2.0:1786100429.474621:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:6681:x1872861960608384:12345-0@lo:502: Request processed in 129us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100429.474628:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786100429.474795:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608384:0@lo:502: 00000040:00080000:0.0:1786100429.474868:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1786100429.474877:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1786100429.475402:0:6699:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786100429.475409:0:6699:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1786100429.475415:0:6699:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100429.475418:0:6699:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1786100429.475422:0:6699:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786100429.475437:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a3c44f30000) 00000020:00000080:0.0:1786100429.475457:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1786100429.475462:0:6699:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1786100429.475523:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a3c6e163000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1786100429.475529:0:6699:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1786100429.475535:0:6699:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5564f2c20ac0b73 00010000:00010000:2.0:1786100429.482018:0:6699:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1786100429.482340:0:6699:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1786100429.485042:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1786100429.485304:0:6699:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1786100429.492570:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1786100429.493338:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1786100429.494521:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1786100429.494532:0:6699:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786100429.494537:0:6699:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100429.494539:0:6699:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1786100429.494543:0:6699:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786100429.494547:0:6699:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100429.494548:0:6699:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1786100429.494551:0:6699:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1786100429.494553:0:6699:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1786100429.494598:0:6699:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786100429.494601:0:6699:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100429.494603:0:6699:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1786100429.494606:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1786100429.498261:0:6681:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1786100429.498303:0:6681:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1786100429.498329:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b65 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.498341:0:6681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b65 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100429.498348:0:6681:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c6e163000 from 1 10000000:01000000:2.0:1786100429.498351:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786100429.498387:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.498395:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.498406:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100429.498430:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608512:0@lo:101: 00000100:00100000:2.0:1786100429.498497:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100429.498546:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6029ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1786100429.498572:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960608512 00000100:00100000:2.0:1786100429.498579:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960608512 00000100:00100000:2.0:1786100429.498634:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786100429.498642:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:6681:x1872861960608512:12345-0@lo:101: 00010000:00010000:2.0:1786100429.498679:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100429.498693:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0b81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0b7a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.498714:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0b81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0b7a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.498724:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0b81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0b7a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.498732:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165fa00, rc 0) 00000100:00100000:2.0:1786100429.498770:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6681:x1872861960608512:12345-0@lo:101: Request processed in 129us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100429.498776:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786100429.498839:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608512:0@lo:101: 00010000:00010000:2.0:1786100429.498852:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b81 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.498860:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0b81 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100429.499028:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608640:0@lo:501: 00000100:00100000:2.0:1786100429.499054:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100429.499083:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6029ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1786100429.502682:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960608640 00000100:00100000:3.0:1786100429.502693:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960608640 00000100:00100000:3.0:1786100429.502739:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786100429.502749:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6681:x1872861960608640:12345-0@lo:501: 00000100:00100000:3.0:1786100429.503139:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6681:x1872861960608640:12345-0@lo:501: Request processed in 390us (4082us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100429.503146:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786100429.503303:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608640:0@lo:501: 00000100:00100000:2.0:1786100429.503350:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608768:0@lo:503: 00000100:00100000:2.0:1786100429.503397:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100429.503434:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6029ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1786100429.503482:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960608768 00000100:00100000:1.0:1786100429.503487:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960608768 00000100:00100000:1.0:1786100429.503517:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1786100429.503524:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6681:x1872861960608768:12345-0@lo:503: 00000100:00100000:1.0:1786100429.503789:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6681:x1872861960608768:12345-0@lo:503: Request processed in 264us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100429.503796:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786100429.503878:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608768:0@lo:503: 00000040:00080000:3.0:1786100429.504141:0:6681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786100429.504208:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608896:0@lo:502: 00000100:00100000:3.0:1786100429.504244:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100429.504270:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f58e840 going to sleep for 11 seconds 00000100:00100000:1.0:1786100429.504373:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960608896 00000100:00100000:1.0:1786100429.504378:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960608896 00000100:00100000:1.0:1786100429.504408:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786100429.504416:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6681:x1872861960608896:12345-0@lo:502: 00000100:00100000:1.0:1786100429.504575:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6681:x1872861960608896:12345-0@lo:502: Request processed in 159us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100429.504583:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786100429.504768:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960608896:0@lo:502: 00000040:00080000:3.0:1786100429.505068:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1786100429.505118:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1786100429.505142:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960609024:0@lo:502: 00000100:00100000:3.0:1786100429.505178:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100429.505239:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f58e840 going to sleep for 11 seconds 00000100:00100000:1.0:1786100429.505397:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960609024 00000100:00100000:1.0:1786100429.505402:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960609024 00000100:00100000:1.0:1786100429.505433:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786100429.505441:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6681:x1872861960609024:12345-0@lo:502: 00000100:00100000:1.0:1786100429.505612:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6681:x1872861960609024:12345-0@lo:502: Request processed in 171us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100429.505619:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786100429.505818:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960609024:0@lo:502: 00000040:00080000:0.0:1786100429.505979:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1786100429.505990:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1786100429.506442:0:6703:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100429.506451:0:6703:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100429.506453:0:6703:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1786100429.506460:0:6703:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a3c6e163000 00000020:00000080:0.0:1786100429.506462:0:6703:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786100429.506480:0:6703:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100429.506483:0:6703:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100429.506485:0:6703:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1786100429.506487:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1786100429.506625:0:6681:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1786100429.506645:0:6681:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786100429.507203:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b81 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.507223:0:6681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b81 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100429.507328:0:6681:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1786100429.507331:0:6681:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a3c6e163000 10000000:01000000:2.0:1786100429.507334:0:6681:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a3c6e163000 10000000:01000000:2.0:1786100429.507338:0:6681:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786100429.507343:0:6681:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a3c6e163000 from 1 10000000:01000000:2.0:1786100429.507345:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786100429.507375:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.507384:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100429.507394:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100429.507413:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960609152:0@lo:101: 00000100:00100000:2.0:1786100429.507462:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100429.507500:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6029a000 going to sleep for 11 seconds 00000100:00100000:3.0:1786100429.507558:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960609152 00000100:00100000:3.0:1786100429.507564:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960609152 00000100:00100000:3.0:1786100429.507601:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1786100429.507609:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6681:x1872861960609152:12345-0@lo:101: 00010000:00010000:3.0:1786100429.507620:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100429.507632:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0b8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0b88 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.507676:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0b8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0b88 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.507685:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0b8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0b88 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100429.507694:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c41511200, rc 0) 00000100:00100000:3.0:1786100429.507731:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:6681:x1872861960609152:12345-0@lo:101: Request processed in 123us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100429.507736:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786100429.507824:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960609152:0@lo:101: 00010000:00010000:0.0:1786100429.507837:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b8f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.507846:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0b8f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100429.507947:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960609280:0@lo:501: 00000100:00100000:0.0:1786100429.507973:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100429.507990:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7ce9c240 going to sleep for 11 seconds 00000100:00100000:3.0:1786100429.508082:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960609280 00000100:00100000:3.0:1786100429.508086:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960609280 00000100:00100000:3.0:1786100429.508114:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786100429.508121:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:6681:x1872861960609280:12345-0@lo:501: 00000100:00100000:3.0:1786100429.508336:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:6681:x1872861960609280:12345-0@lo:501: Request processed in 215us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100429.508351:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786100429.508382:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960609280:0@lo:501: 00000100:00100000:3.0:1786100429.508406:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960609408:0@lo:503: 00000100:00100000:3.0:1786100429.508440:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100429.508453:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f58e480 going to sleep for 11 seconds 00000100:00100000:3.0:1786100429.508466:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960609408 00000100:00100000:3.0:1786100429.508469:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960609408 00000100:00100000:3.0:1786100429.508484:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1786100429.508489:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:6681:x1872861960609408:12345-0@lo:503: 00000100:00100000:3.0:1786100429.508609:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:6681:x1872861960609408:12345-0@lo:503: Request processed in 119us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100429.508614:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1786100429.508644:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960609408:0@lo:503: 00000040:00080000:3.0:1786100429.508863:0:6681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786100429.509014:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960609536:0@lo:502: 00000100:00100000:3.0:1786100429.509041:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100429.509091:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f58e480 going to sleep for 11 seconds 00000100:00100000:2.0:1786100429.509246:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960609536 00000100:00100000:2.0:1786100429.509251:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960609536 00000100:00100000:2.0:1786100429.509311:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786100429.509319:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:6681:x1872861960609536:12345-0@lo:502: 00000100:00100000:2.0:1786100429.509472:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:6681:x1872861960609536:12345-0@lo:502: Request processed in 154us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100429.509479:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786100429.509559:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960609536:0@lo:502: 00000040:00080000:3.0:1786100429.509804:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1786100429.509850:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1786100429.509897:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1786100429.509949:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1786100429.509983:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1786100429.510026:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1786100429.510061:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1786100429.510092:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1786100429.510147:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1786100429.510180:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1786100429.510212:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1786100429.510258:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1786100429.510296:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1786100429.510330:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1786100429.510378:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1786100429.510417:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1786100429.510452:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1786100429.510500:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1786100429.510537:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1786100429.510573:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1786100429.510639:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1786100429.510715:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1786100429.510766:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1786100429.510815:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1786100429.510848:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1786100429.510879:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1786100429.510942:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1786100429.510977:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1786100429.511016:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960609664:0@lo:502: 00000100:00100000:3.0:1786100429.511075:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100429.511112:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f58e480 going to sleep for 11 seconds 00000100:00100000:2.0:1786100429.511273:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960609664 00000100:00100000:2.0:1786100429.511280:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960609664 00000100:00100000:2.0:1786100429.511321:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786100429.511329:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:6681:x1872861960609664:12345-0@lo:502: 00000100:00100000:2.0:1786100429.511528:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:6681:x1872861960609664:12345-0@lo:502: Request processed in 199us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100429.511535:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786100429.511744:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960609664:0@lo:502: 00000040:00080000:3.0:1786100429.511811:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1786100429.511821:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1786100429.512340:0:6704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1786100429.512355:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a3c472db380) 00000020:00000080:3.0:1786100429.512374:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1786100429.512582:0:6704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a3c6e163000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786100429.512586:0:6704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a3c6e163000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786100429.512595:0:6704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a3c6e163000 3 00010000:00080000:3.0:1786100429.512629:0:6704:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a3c7f867000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.153@tcp at head 00010000:00010000:3.0:1786100429.514509:0:6704:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1786100429.514605:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1786100429.514640:0:6704:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786100429.517064:0:6704:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5564f2c20ac0b9d 00000100:00080000:3.0:1786100429.517085:0:6704:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786100429.517092:0:6704:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a3c7f867000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:3.0:1786100429.517178:0:6704:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3c7ba2d880 x1872861960609792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786100429.517215:0:6704:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1786100429.517375:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960609920:0@lo:400: 00000100:00100000:3.0:1786100429.520749:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100429.520983:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960609920 00000100:00100000:0.0:1786100429.520991:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960609920 00000100:00100000:0.0:1786100429.521033:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786100429.521041:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960609920:12345-0@lo:400: 00000100:00100000:0.0:1786100429.521111:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960609920:12345-0@lo:400: Request processed in 70us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100429.521118:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1786100429.521242:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a3c7ba2d180 x1872861960609920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100429.521257:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960609920:0@lo:400: 00000100:00100000:1.0:1786100429.521364:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1872861960609792:0@lo:38: 00000100:00100000:1.0:1786100429.521406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100429.521440:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960609792 00000100:00100000:1.0:1786100429.521443:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960609792 00000100:00100000:1.0:1786100429.521464:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786100429.521469:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1872861960609792:12345-0@lo:38: 00010000:00080000:1.0:1786100429.521490:0:5844:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:1.0:1786100429.521525:0:5844:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5564f2c20ac0ba4 00000004:00100000:1.0:1786100429.521540:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786100429.521570:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9a3c6f6ee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786100429.521608:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1872861960609792:12345-0@lo:38: Request processed in 138us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100429.521615:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1786100429.521642:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a3c7ba2d880 x1872861960609792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786100439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100429.521671:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786100429.521684:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1786100429.521691:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1786100429.521695:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1786100429.521698:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c7f867000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1786100429.521703:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1872861960609792:0@lo:38: 00000040:00080000:3.0:1786100429.522019:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1786100429.522149:0:6681:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1786100429.522173:0:6681:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786100429.522191:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b8f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.522201:0:6681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0b8f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786100429.522245:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786100429.522247:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786100429.522249:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786100429.522250:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786100429.522251:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786100429.522253:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786100429.522254:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786100429.522255:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786100429.522257:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786100429.522259:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786100429.522260:0:6681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786100429.522264:0:6681:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1786100429.522266:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786100429.522267:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786100429.522268:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786100429.522269:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786100429.522271:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786100429.522272:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786100429.522273:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786100429.522274:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786100429.522275:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786100429.522280:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786100429.522281:0:6681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786100429.522319:0:6681:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1786100429.522333:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960610048:0@lo:253: 00000100:00100000:1.0:1786100429.522370:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100429.522395:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c50c5e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100429.522411:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960610048 00000100:00100000:1.0:1786100429.522415:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960610048 00000100:00100000:1.0:1786100429.522439:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786100429.522446:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:6681:x1872861960610048:12345-0@lo:253: 20000000:01000000:1.0:1786100429.522464:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1786100429.522476:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1786100429.545042:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1786100429.545086:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1786100429.545628:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1786100429.545634:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1786100429.545855:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.545874:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0b11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0b0a expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.545941:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.545985:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0b0a expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100429.545999:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0b11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0b0a expref: 13 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100429.546013:0:5859:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1872861960610176:0@lo:104: 00000100:00100000:0.0:1786100429.546073:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100429.546169:0:5859:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7ce9ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100429.551859:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960610176 00000100:00100000:1.0:1786100429.551872:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960610176 00000100:00100000:1.0:1786100429.551981:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786100429.551990:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:5859:x1872861960610176:12345-0@lo:104: 00010000:00010000:1.0:1786100429.552008:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbae00/0x5564f2c20ac0b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0b11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100429.552108:0:5859:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1872861960610176:0@lo:104: 00010000:00010000:1.0:1786100429.552128:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552150:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786100429.552155:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:5859:x1872861960610176:12345-0@lo:104: Request processed in 168us (6083us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100429.552162:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1786100429.552178:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100429.552184:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbae00/0x5564f2c20ac0b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0b11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552204:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbae00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:1.0:1786100429.552209:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbae00/0x5564f2c20ac0b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0b11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552216:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbae00/0x5564f2c20ac0b0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0b11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786100429.552223:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbae00/0x5564f2c20ac0b0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0b11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100429.552229:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1786100429.552260:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbae00/0x5564f2c20ac0b0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552266:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786100429.552282:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbae00/0x5564f2c20ac0b0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552289:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbae00/0x5564f2c20ac0b0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b11 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552305:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100429.552307:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100429.552308:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100429.552319:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960610304:0@lo:103: 00000100:00100000:1.0:1786100429.552355:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100429.552400:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960610304 00000100:00100000:1.0:1786100429.552404:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960610304 00010000:00010000:1.0:1786100429.552418:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0b11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0b0a expref: 14 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100429.552444:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786100429.552449:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:3308:x1872861960610304:12345-0@lo:103: 00010000:00010000:1.0:1786100429.552459:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100429.552465:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0b11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0b0a expref: 14 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552474:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0b0a expref: 14 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552487:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0b11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0b0a expref: 14 pid: 5835 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552500:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552508:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786100429.552521:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006888211s 00010000:00010000:1.0:1786100429.552525:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552531:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552538:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552543:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552558:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbaa00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100429.552563:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552570:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552583:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552592:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100429.552619:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:3308:x1872861960610304:12345-0@lo:103: Request processed in 169us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100429.552626:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786100429.552695:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960610304:0@lo:103: 00010000:00010000:1.0:1786100429.552709:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552716:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100429.552723:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0bab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100429.556189:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:6681:x1872861960610048:12345-0@lo:253: Request processed in 33735us (33810us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100429.556204:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786100429.556285:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:6681:1872861960610048:0@lo:253: 10000000:01000000:1.0:1786100429.556300:0:6681:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1786100429.556304:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786100429.556305:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786100429.556318:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786100429.556320:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786100429.556321:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786100429.556323:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786100429.556324:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786100429.556326:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786100429.556327:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786100429.556329:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786100429.556330:0:6681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786100429.556345:0:6681:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1786100429.561283:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1786100429.561460:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1786100429.561697:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1786100429.561859:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1786100429.562082:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1786100429.562272:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1786100429.563983:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1786100429.751447:0:6681:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1786100429.751454:0:6681:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1786100429.751487:0:6681:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1786100429.751551:0:6681:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.153@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1786100429.751569:0:6681:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1786100429.751595:0:6681:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1786100429.989090:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100431.019591:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100432.039212:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100433.061156:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100434.089355:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100434.853443:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960610560:0@lo:400: 00000100:00100000:1.0:1786100434.853533:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100434.853596:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960610688:0@lo:400: 00000100:00100000:1.0:1786100434.853620:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100434.853696:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960610560 00000100:00100000:3.0:1786100434.853697:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960610688 00000100:00100000:1.0:1786100434.853703:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960610560 00000100:00100000:3.0:1786100434.853705:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960610688 00000100:00100000:1.0:1786100434.853749:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786100434.853758:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960610560:12345-0@lo:400: 00000100:00100000:1.0:1786100434.853809:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960610560:12345-0@lo:400: Request processed in 52us (276us total) trans 0 rc 0/0 00000100:00080000:2.0:1786100434.853847:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100434.854240:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786100434.854249:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786100434.854255:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960610688:12345-0@lo:400: 00000100:00100000:1.0:1786100434.854284:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960610432:0@lo:400: 00010000:00080000:2.0:1786100434.854373:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c745b3b80 x1872861960610688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100434.854387:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960610688:0@lo:400: 00000100:00100000:3.0:1786100434.854762:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960610688:12345-0@lo:400: Request processed in 511us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100434.854770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100434.854776:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1786100434.854868:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c745b2a00 x1872861960610560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100434.854878:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960610560:0@lo:400: 00000100:00100000:2.0:1786100434.854906:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960610432 00000100:00100000:2.0:1786100434.854912:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960610432 00000100:00100000:2.0:1786100434.854949:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1786100434.854957:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:3305:x1872861960610432:12345-0@lo:400: 00000100:00100000:2.0:1786100434.855002:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:3305:x1872861960610432:12345-0@lo:400: Request processed in 47us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100434.855008:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1786100434.855043:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960610432:0@lo:400: 00010000:00010000:1.0:1786100435.114135:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786100435.339516:0:7047:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1786100436.133083:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1786100436.388747:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786100436.388757:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a3c47abb000 from 21 10000000:01000000:1.0:1786100436.388764:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786100436.388816:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100436.388829:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100436.388842:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100436.388883:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960610816:0@lo:101: 00000100:00100000:1.0:1786100436.388972:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100436.389122:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47de4780 going to sleep for 11 seconds 00000100:00100000:3.0:1786100436.389483:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960610816 00000100:00100000:3.0:1786100436.389499:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960610816 00000100:00100000:3.0:1786100436.389563:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1786100436.389574:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5840:x1872861960610816:12345-0@lo:101: 00010000:00010000:3.0:1786100436.389593:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100436.389610:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c41510e00/0x5564f2c20ac0bb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0bb2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100436.389639:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c41510e00/0x5564f2c20ac0bb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0bb2 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100436.389669:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c41510e00/0x5564f2c20ac0bb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0bb2 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100436.389681:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c41510e00, rc 0) 00000100:00100000:3.0:1786100436.389736:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:5840:x1872861960610816:12345-0@lo:101: Request processed in 163us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100436.389743:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1786100436.389802:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960610816:0@lo:101: 00010000:00010000:3.0:1786100436.389821:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0bb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100436.389831:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0bb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100436.389985:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960610944:0@lo:501: 00000100:00100000:3.0:1786100436.390017:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100436.390036:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f58e300 going to sleep for 11 seconds 00000100:00100000:3.0:1786100436.390050:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960610944 00000100:00100000:3.0:1786100436.390054:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960610944 00000100:00100000:3.0:1786100436.390083:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1786100436.390089:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:5840:x1872861960610944:12345-0@lo:501: 00000100:00100000:3.0:1786100436.390382:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:5840:x1872861960610944:12345-0@lo:501: Request processed in 291us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100436.390390:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1786100436.390499:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960610944:0@lo:501: 00000100:00100000:3.0:1786100436.390532:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960611072:0@lo:503: 00000100:00100000:3.0:1786100436.390573:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100436.390588:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f58e300 going to sleep for 11 seconds 00000100:00100000:3.0:1786100436.390601:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960611072 00000100:00100000:3.0:1786100436.390605:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960611072 00000100:00100000:3.0:1786100436.390627:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1786100436.390634:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:5840:x1872861960611072:12345-0@lo:503: 00000100:00100000:3.0:1786100436.390811:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:5840:x1872861960611072:12345-0@lo:503: Request processed in 176us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100436.390819:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1786100436.391484:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960611072:0@lo:503: 00000100:00100000:0.0:1786100436.392012:0:7113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7113:1872861960611200:0@lo:502: 00000100:00100000:0.0:1786100436.392074:0:7113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100436.392112:0:7113:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4473f540 going to sleep for 11 seconds 00000100:00100000:3.0:1786100436.392477:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960611200 00000100:00100000:3.0:1786100436.392485:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960611200 00000100:00100000:3.0:1786100436.392531:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786100436.392541:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7113:x1872861960611200:12345-0@lo:502: 00000100:00100000:3.0:1786100436.392795:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7113:x1872861960611200:12345-0@lo:502: Request processed in 255us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100436.392803:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786100436.393118:0:7113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7113:1872861960611200:0@lo:502: 00000100:00100000:0.0:1786100436.393176:0:7113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7113:1872861960611328:0@lo:502: 00000100:00100000:0.0:1786100436.393221:0:7113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100436.393248:0:7113:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4473f540 going to sleep for 11 seconds 00000100:00100000:3.0:1786100436.393489:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960611328 00000100:00100000:3.0:1786100436.393494:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960611328 00000100:00100000:3.0:1786100436.393534:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786100436.393543:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7113:x1872861960611328:12345-0@lo:502: 00000100:00100000:3.0:1786100436.393733:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7113:x1872861960611328:12345-0@lo:502: Request processed in 190us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100436.393740:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786100436.394111:0:7113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7113:1872861960611328:0@lo:502: 00000040:00080000:0.0:1786100436.394134:0:7113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1786100436.394583:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1786100436.394607:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786100436.394617:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0bb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100436.394630:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0bb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100436.394640:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786100436.394643:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a3c47abb000 from 4 10000000:01000000:3.0:1786100436.394646:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786100436.394800:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100436.394810:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100436.394821:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100436.394842:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960611456:0@lo:101: 00000100:00100000:3.0:1786100436.395629:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100436.395752:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f58e780 going to sleep for 11 seconds 00000100:00100000:0.0:1786100436.398767:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960611456 00000100:00100000:0.0:1786100436.398788:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960611456 00000100:00100000:0.0:1786100436.398966:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786100436.398978:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:5840:x1872861960611456:12345-0@lo:101: 00010000:00010000:0.0:1786100436.399003:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100436.399029:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0bc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0bc0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100436.399063:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0bc0 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100436.399075:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0bc0 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100436.399087:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbbe00, rc 0) 00000100:00100000:0.0:1786100436.399187:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960611456:12345-0@lo:101: Request processed in 212us (3561us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100436.399195:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786100436.403072:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960611456:0@lo:101: 00010000:00010000:0.0:1786100436.403107:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0bc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100436.403122:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0bc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100436.403209:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960611584:0@lo:256: 00000100:00100000:0.0:1786100436.403296:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100436.404500:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4473fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100436.405517:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960611584 00000100:00100000:3.0:1786100436.405531:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960611584 00000100:00100000:3.0:1786100436.406572:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786100436.406589:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960611584:12345-0@lo:256: 20000000:01000000:3.0:1786100436.406624:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1786100436.406642:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786100436.406645:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1786100436.406828:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960611584:12345-0@lo:256: Request processed in 244us (3531us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100436.406838:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1786100436.409549:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960611584:0@lo:256: 10000000:01000000:0.0:1786100436.409637:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786100436.409997:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0bc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100436.410014:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0bc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100436.410025:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1786100436.410027:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1786100436.410030:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786100436.410072:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100436.410081:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100436.410092:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100436.410131:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960611712:0@lo:101: 00000100:00100000:0.0:1786100436.410213:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100436.410256:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47313a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786100436.410281:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960611712 00000100:00100000:0.0:1786100436.410288:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960611712 00000100:00100000:0.0:1786100436.410341:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786100436.410351:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960611712:12345-0@lo:101: 00010000:00010000:0.0:1786100436.410367:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100436.410383:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbae00/0x5564f2c20ac0bd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0bce expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100436.410551:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbae00/0x5564f2c20ac0bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0bce expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100436.410565:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbbae00/0x5564f2c20ac0bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0bce expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100436.410575:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbae00, rc 0) 00000100:00100000:0.0:1786100436.410619:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960611712:12345-0@lo:101: Request processed in 269us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100436.410625:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786100436.412480:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960611712:0@lo:101: 00010000:00010000:0.0:1786100436.412514:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0bd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100436.412528:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0bd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100436.412630:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960611840:0@lo:501: 00000100:00100000:0.0:1786100436.412712:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100436.412752:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47313a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786100436.413705:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960611840 00000100:00100000:3.0:1786100436.413718:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960611840 00000100:00100000:3.0:1786100436.413769:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1786100436.413781:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960611840:12345-0@lo:501: 00000100:00100000:3.0:1786100436.415602:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960611840:12345-0@lo:501: Request processed in 1815us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100436.415618:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1786100436.415709:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960611840:0@lo:501: 00000100:00100000:3.0:1786100436.415780:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960611968:0@lo:503: 00000100:00100000:3.0:1786100436.415840:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100436.416403:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f58e840 going to sleep for 11 seconds 00000100:00100000:3.0:1786100436.416428:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960611968 00000100:00100000:3.0:1786100436.416435:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960611968 00000100:00100000:3.0:1786100436.416484:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786100436.416495:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960611968:12345-0@lo:503: 00000100:00100000:3.0:1786100436.416820:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960611968:12345-0@lo:503: Request processed in 326us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100436.416828:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786100436.417017:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960611968:0@lo:503: 00000100:00100000:3.0:1786100436.417302:0:7114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7114:1872861960612096:0@lo:502: 00000100:00100000:3.0:1786100436.417346:0:7114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100436.417367:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960612096 00000100:00100000:3.0:1786100436.417372:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960612096 00000100:00100000:3.0:1786100436.417951:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786100436.417964:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:7114:x1872861960612096:12345-0@lo:502: 00000100:00100000:3.0:1786100436.420025:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:7114:x1872861960612096:12345-0@lo:502: Request processed in 2054us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100436.420041:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786100436.420124:0:7114:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f58e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100436.420153:0:7114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7114:1872861960612096:0@lo:502: 00000020:01000000:3.0:1786100436.420193:0:7114:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786100436.420202:0:7114:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1786100436.420210:0:7114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786100436.420213:0:7114:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1786100436.420219:0:7114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1786100436.420223:0:7114:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.153@tcp to nid 0x20000c0a8ce99 (192.168.206.153@tcp) 00000020:01000000:3.0:1786100436.420252:0:7114:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1786100436.420256:0:7114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786100436.421497:0:7114:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a3c7c0199c0) 00000020:00000080:3.0:1786100436.421530:0:7114:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1786100436.421544:0:7114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1786100436.421676:0:7114:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1786100436.421683:0:7114:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1786100436.421691:0:7114:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac0be3 00010000:00080000:3.0:1786100436.421746:0:7114:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a3c4504e000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.153@tcp at head 00010000:00010000:3.0:1786100436.423125:0:7114:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1786100436.471199:0:7114:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1786100436.471231:0:7114:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1786100436.471838:0:7114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786100436.472017:0:7114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786100436.472075:0:7114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1786100436.472146:0:7114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1786100436.472522:0:7121:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786100436.472528:0:7121:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1786100436.475087:0:7114:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786100436.475112:0:7114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1786100436.475165:0:7114:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1786100436.475193:0:7114:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5564f2c20ac0bea 00000100:00080000:2.0:1786100436.475206:0:7114:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786100436.475214:0:7114:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a3c4504e000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:2.0:1786100436.475261:0:7114:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3c745d2d80 x1872861960612224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786100436.475293:0:7114:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1786100436.475359:0:7114:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100436.475364:0:7114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100436.475366:0:7114:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1786100436.475369:0:7114:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786100436.475374:0:7114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100436.475375:0:7114:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786100436.475378:0:7114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786100436.475380:0:7114:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1786100436.475426:0:7114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7114:1872861960612352:0@lo:502: 00000100:00100000:2.0:1786100436.475523:0:7114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100436.475572:0:7114:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c49296d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786100436.475609:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960612352 00000100:00100000:2.0:1786100436.475616:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960612352 00000100:00100000:2.0:1786100436.475683:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786100436.475695:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:7114:x1872861960612352:12345-0@lo:502: 00000100:00100000:2.0:1786100436.475990:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:7114:x1872861960612352:12345-0@lo:502: Request processed in 296us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100436.475998:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786100436.476077:0:7114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7114:1872861960612352:0@lo:502: 00000020:01000000:2.0:1786100436.476104:0:7114:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100436.476113:0:7114:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100436.476115:0:7114:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1786100436.476119:0:7114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1786100436.476145:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960612480:0@lo:400: 00000020:01000000:2.0:1786100436.476239:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1786100436.476261:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1786100436.476271:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0bd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100436.476283:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0bd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100436.476294:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1786100436.476297:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a3c44f34d40 from 1 10000000:01000000:2.0:1786100436.476300:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786100436.476327:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100436.476336:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100436.476346:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100436.476360:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960612736:0@lo:101: 00000100:00100000:2.0:1786100436.476390:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100436.476409:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c49296d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786100436.476425:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960612736 00000100:00100000:2.0:1786100436.476430:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960612736 00000100:00100000:0.0:1786100436.476453:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100436.476456:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786100436.476465:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960612736:12345-0@lo:101: 00010000:00010000:2.0:1786100436.476475:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100436.476497:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac0bf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0bf1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100436.476507:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960612608:0@lo:400: 00010000:00010000:2.0:1786100436.476523:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac0bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0bf1 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100436.476536:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac0bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0bf1 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100436.476545:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786100436.476548:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f000, rc 0) 00000100:00100000:0.0:1786100436.476588:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960612480 00000100:00100000:2.0:1786100436.476589:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960612736:12345-0@lo:101: Request processed in 124us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100436.476594:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960612480 00000100:00100000:2.0:1786100436.476599:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1786100436.476631:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960612608 00000100:00100000:0.0:1786100436.476635:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960612608 00000100:00100000:2.0:1786100436.476637:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960612736:0@lo:101: 00010000:00010000:2.0:1786100436.476679:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0bf8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100436.476688:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0bf8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100436.476732:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960612864:0@lo:501: 00000100:00100000:2.0:1786100436.476760:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100436.476774:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c49296d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786100436.476787:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960612864 00000100:00100000:2.0:1786100436.476791:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960612864 00000100:00100000:2.0:1786100436.476815:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1786100436.476822:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960612864:12345-0@lo:501: 00000100:00100000:0.0:1786100436.476991:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786100436.477001:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960612480:12345-0@lo:400: 00000100:00100000:0.0:1786100436.477050:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960612480:12345-0@lo:400: Request processed in 50us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100436.477058:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786100436.477076:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960612864:12345-0@lo:501: Request processed in 253us (312us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786100436.477076:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786100436.477087:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960612608:12345-0@lo:400: 00000100:00100000:2.0:1786100436.477102:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1786100436.477131:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960612608:12345-0@lo:400: Request processed in 45us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100436.477139:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786100436.477145:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960612864:0@lo:501: 10000000:01000000:2.0:1786100436.477169:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00000100:00080000:0.0:1786100436.477172:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786100436.477176:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0bf8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100436.477184:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0bf8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1786100436.477201:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c44f79500 x1872861960612480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100436.477214:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960612480:0@lo:400: 00010000:00080000:0.0:1786100436.477249:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c44f79180 x1872861960612608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100436.477257:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960612608:0@lo:400: 00000100:00100000:1.0:1786100436.477411:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960612224:0@lo:8: 00000100:00100000:1.0:1786100436.477454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100436.479985:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960612224 00000100:00100000:2.0:1786100436.480007:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960612224 00000100:00100000:2.0:1786100436.480063:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786100436.480074:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1872861960612224:12345-0@lo:8: 00010000:00080000:2.0:1786100436.480112:0:6683:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:2.0:1786100436.480153:0:6683:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5564f2c20ac0bff 00002000:00100000:2.0:1786100436.480258:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a3c7f864800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1786100436.480264:0:6683:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1786100436.480269:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1786100436.480643:0:6683:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1786100436.480854:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786100436.480893:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9a3c7f862000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786100436.481003:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1872861960612224:12345-0@lo:8: Request processed in 928us (3545us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100436.481012:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1786100436.481299:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c745d2d80 x1872861960612224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786100446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100436.481312:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786100436.481321:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1786100436.481330:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1786100436.481336:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1786100436.481339:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c4504e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1786100436.481364:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1786100436.481370:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960612224:0@lo:8: 00000004:00080000:3.0:1786100436.481500:0:7121:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1786100436.481642:0:7121:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 177723990549ns, next at 0ns, rc = 0 00000004:00080000:0.0:1786100436.548180:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1786100436.594759:0:7122:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1786100436.594792:0:7122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7122:1872861960613120:0@lo:7: 00000100:00100000:1.0:1786100436.594871:0:7122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100436.594924:0:7122:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47de4480 going to sleep for 11 seconds 00000100:00100000:1.0:1786100436.594961:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960612992:0@lo:13: 00000100:00100000:1.0:1786100436.595003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100436.595047:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960613120 00000100:00100000:1.0:1786100436.595054:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960613120 00000100:00100000:1.0:1786100436.595101:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786100436.595110:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7122:x1872861960613120:12345-0@lo:7: 00000100:00080000:2.0:1786100436.603729:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786100436.603762:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960612992 00000100:00100000:2.0:1786100436.603778:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960612992 00000100:00100000:2.0:1786100436.603827:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786100436.603837:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1872861960612992:12345-0@lo:13: 00002000:00000024:2.0:1786100436.603886:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1786100436.604064:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1872861960612992:12345-0@lo:13: Request processed in 227us (9059us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100436.604071:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1786100436.607032:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c745b0380 x1872861960612992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100436.607059:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960612992:0@lo:13: 00002000:00080000:1.0:1786100436.611583:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1786100436.611592:0:6686:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1786100436.612259:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7122:x1872861960613120:12345-0@lo:7: Request processed in 17144us (17382us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100436.612271:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1786100436.612561:0:7122:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c745b1c00 x1872861960613120/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1786100452 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100436.612577:0:7122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7122:1872861960613120:0@lo:7: 00000004:00080000:0.0:1786100436.612591:0:7122:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1786100436.615746:0:7122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7122:1872861960613248:0@lo:5: 00000100:00100000:0.0:1786100436.615827:0:7122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100436.616045:0:7122:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47313300 going to sleep for 11 seconds 00000100:00100000:2.0:1786100436.616124:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960613248 00000100:00100000:2.0:1786100436.616133:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960613248 00000100:00100000:2.0:1786100436.616212:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786100436.616222:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7122:x1872861960613248:12345-0@lo:5: 00002000:00080000:2.0:1786100436.616250:0:6684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1786100436.616255:0:6684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1786100436.616584:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7122:x1872861960613248:12345-0@lo:5: Request processed in 363us (758us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1786100436.616591:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1786100436.616695:0:7122:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c44f79180 x1872861960613248/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786100452 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100436.616711:0:7122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7122:1872861960613248:0@lo:5: 00000004:00080000:1.0:1786100436.616723:0:7122:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1786100436.616756:0:7122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7122:1872861960613376:0@lo:700: 00000100:00100000:1.0:1786100436.616782:0:7122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100436.616801:0:7122:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47de4600 going to sleep for 11 seconds 00000100:00100000:3.0:1786100436.617070:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960613376 00000100:00100000:3.0:1786100436.617074:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960613376 00000100:00100000:3.0:1786100436.617104:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786100436.617111:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7122:x1872861960613376:12345-0@lo:700: 00000100:00100000:3.0:1786100436.617138:0:6692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6692:1872861960613504:0@lo:700: 00000100:00100000:3.0:1786100436.617170:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100436.617188:0:6692:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c59ac5540 going to sleep for 11 seconds 00000100:00100000:3.0:1786100436.617207:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960613504 00000100:00100000:3.0:1786100436.617211:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960613504 00000100:00100000:3.0:1786100436.617237:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786100436.617244:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6692:x1872861960613504:12345-0@lo:700: 40000000:02000000:1.0:1786100436.642349:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1786100436.648957:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6692:x1872861960613504:12345-0@lo:700: Request processed in 31706us (31778us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100436.648975:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1786100436.649023:0:6692:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c7ba2ca80 x1872861960613504/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1786100452 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100436.649038:0:6692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6692:1872861960613504:0@lo:700: 40000000:02000000:1.0:1786100436.649051:0:6692:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1786100436.716093:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7122:x1872861960613376:12345-0@lo:700: Request processed in 98972us (99299us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100436.716113:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1786100436.716141:0:7122:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c745b3800 x1872861960613376/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1786100452 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100436.716157:0:7122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7122:1872861960613376:0@lo:700: 00000001:00080000:1.0:1786100436.716159:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1786100436.716167:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1786100436.762736:0:7122:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1786100436.767104:0:7122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7122:1872861960613632:0@lo:5: 00000100:00100000:2.0:1786100436.767168:0:7122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100436.767222:0:7122:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7ce7b000 going to sleep for 11 seconds 00000100:00100000:1.0:1786100436.767274:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960613632 00000100:00100000:1.0:1786100436.767281:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960613632 00000100:00100000:1.0:1786100436.767335:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786100436.767345:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7122:x1872861960613632:12345-0@lo:5: 00002000:00080000:1.0:1786100436.773249:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1786100436.773269:0:6686:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1786100436.776150:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7122:x1872861960613632:12345-0@lo:5: Request processed in 8799us (8974us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1786100436.776163:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1786100436.776291:0:7122:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c745d0a80 x1872861960613632/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786100452 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100436.776305:0:7122:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1786100436.776319:0:7122:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a3c745d0a80 x1872861960613632/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786100452 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100436.776337:0:7122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7122:1872861960613632:0@lo:5: 00000004:00080000:2.0:1786100436.776350:0:7122:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1786100437.160099:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100438.181572:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100439.205891:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786100439.677692:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1786100440.230312:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100441.253590:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100441.509753:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960614016:0@lo:400: 00000100:00100000:2.0:1786100441.509828:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100441.509885:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786100441.509891:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960614144:0@lo:400: 00000100:00100000:2.0:1786100441.509921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100441.509954:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960614144 00000100:00100000:2.0:1786100441.509960:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960614144 00000100:00100000:2.0:1786100441.510006:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786100441.510016:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960614144:12345-0@lo:400: 00000100:00100000:2.0:1786100441.510062:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960614144:12345-0@lo:400: Request processed in 48us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100441.510068:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1786100441.510086:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786100441.510111:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c745d3800 x1872861960614144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100441.510121:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1786100441.510137:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960614144:0@lo:400: 00000100:00100000:3.0:1786100441.511747:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960613888:0@lo:400: 00000100:00100000:3.0:1786100441.511794:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100441.511834:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786100441.511840:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960613760:0@lo:400: 00000100:00100000:3.0:1786100441.511868:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100441.512012:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960613760 00000100:00100000:2.0:1786100441.512018:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960613760 00000100:00100000:2.0:1786100441.512058:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1786100441.512066:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:3308:x1872861960613760:12345-0@lo:400: 00000100:00100000:2.0:1786100441.512110:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:3308:x1872861960613760:12345-0@lo:400: Request processed in 44us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100441.512131:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1786100441.512177:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960613760:0@lo:400: 00000100:00100000:2.0:1786100441.513742:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960614016 00000100:00100000:2.0:1786100441.513752:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960614016 00000100:00100000:2.0:1786100441.513800:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960613888 00000100:00100000:2.0:1786100441.513803:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960613888 00000100:00100000:2.0:1786100441.513830:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786100441.513839:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960614016:12345-0@lo:400: 00000100:00100000:2.0:1786100441.513902:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960614016:12345-0@lo:400: Request processed in 64us (4084us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100441.513908:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786100441.513922:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786100441.513929:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960613888:12345-0@lo:400: 00000100:00100000:2.0:1786100441.513959:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960613888:12345-0@lo:400: Request processed in 31us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100441.513964:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1786100441.513999:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c745d1f80 x1872861960613888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100441.514011:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960613888:0@lo:400: 00010000:00080000:2.0:1786100441.514040:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c745d2680 x1872861960614016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100441.514048:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960614016:0@lo:400: 00000100:00080000:1.0:1786100441.514668:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100442.021505:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786100442.021529:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960614272:0@lo:13: 00000100:00100000:2.0:1786100442.021594:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100442.021971:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960614272 00000100:00100000:2.0:1786100442.021979:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960614272 00000100:00100000:2.0:1786100442.022024:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786100442.022033:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960614272:12345-0@lo:13: 00002000:00000024:2.0:1786100442.022066:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100442.024064:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960614272:12345-0@lo:13: Request processed in 2025us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100442.024077:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1786100442.024133:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c745d2680 x1872861960614272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100442.024155:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960614272:0@lo:13: 00010000:00010000:3.0:1786100442.279262:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100443.301906:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100444.325143:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1786100445.305773:0:7619:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1786100445.305778:0:7619:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1786100445.306192:0:7619:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a3c7f9ee000 00000020:01000004:1.0:1786100445.306207:0:7619:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1786100445.306220:0:7619:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1786100445.306244:0:7619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a3c7f4f4d40) 00000020:00000080:1.0:1786100445.306261:0:7619:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1786100445.326638:0:7619:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1786100445.327219:0:7619:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:1.0:1786100445.352463:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1786100445.358224:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1786100445.365197:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786100445.365233:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1786100445.365292:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786100445.365321:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1786100445.365963:0:7619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1786100445.365982:0:7619:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786100445.365995:0:7619:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5564f2c20ac0c0d 00000020:01000004:3.0:1786100445.366002:0:7619:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1786100445.366022:0:7619:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1786100445.366153:0:7619:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1786100445.366161:0:7619:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1786100445.366183:0:7619:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1786100445.366187:0:7619:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1786100445.391002:0:7619:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1786100445.391158:0:7619:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.153@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1786100445.391163:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1786100445.391165:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786100445.391166:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786100445.391168:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786100445.391169:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786100445.391171:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786100445.391172:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786100445.391174:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1786100445.391175:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1786100445.391177:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786100445.391178:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1786100445.391181:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1786100445.391184:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786100445.391185:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786100445.391186:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786100445.391188:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786100445.391189:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786100445.391190:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786100445.391191:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786100445.391192:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1786100445.391193:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1786100445.391194:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786100445.391195:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1786100445.391221:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1786100445.391239:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960614400:0@lo:253: 00000100:00100000:0.0:1786100445.391307:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100445.391495:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67180 going to sleep for 11 seconds 00000100:00100000:2.0:1786100445.391632:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960614400 00000100:00100000:2.0:1786100445.391640:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960614400 00000100:00100000:2.0:1786100445.391959:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786100445.391968:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:7619:x1872861960614400:12345-0@lo:253: 20000000:01000000:2.0:1786100445.391997:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1786100445.392002:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1786100445.392007:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1786100445.392010:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1786100445.393582:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786100445.393945:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1786100445.393959:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1786100445.393996:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1786100445.394003:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1786100445.394219:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1786100445.394287:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1786100445.394984:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1786100445.395010:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.153@tcp 20000000:01000000:2.0:1786100445.395013:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.153@tcp (null) (null) (null) 00000040:00080000:2.0:1786100445.395307:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1786100445.395316:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1786100445.395436:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1786100445.395507:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.153@tcp (null) (null) 00000040:00080000:2.0:1786100445.395545:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1786100445.395554:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1786100445.395583:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1786100445.395631:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1786100445.397594:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1786100445.397623:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.153@tcp 20000000:01000000:2.0:1786100445.397626:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.153@tcp (null) (null) (null) 00000040:00080000:2.0:1786100445.397784:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1786100445.397857:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1786100445.397896:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1786100445.397904:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.153@tcp (null) (null) 00000040:00080000:2.0:1786100445.397933:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1786100445.397942:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1786100445.398006:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1786100445.398562:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1786100445.398583:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1786100445.398587:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1786100445.398592:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1786100445.398594:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1786100445.398596:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1786100445.398609:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1786100445.398611:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1786100445.399008:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1786100445.399011:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1786100445.400559:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1786100445.400749:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1786100445.400787:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1786100445.401333:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1786100445.401523:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1786100445.401594:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1786100445.401606:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1786100445.401608:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1786100445.402956:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1786100445.403018:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1786100445.403219:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1786100445.403877:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1786100445.403922:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1786100445.404004:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1786100445.404018:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1786100445.404020:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1786100445.404964:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1786100445.405017:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1786100445.405206:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1786100445.405609:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1786100445.405983:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1786100445.406157:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1786100445.406171:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1786100445.406174:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1786100445.406869:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1786100445.407233:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1786100445.407275:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1786100445.407340:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1786100445.407441:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1786100445.407529:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.407549:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0b5e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.407556:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0b8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0b88 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.407562:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c41510e00/0x5564f2c20ac0bb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0bb2 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.407581:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4fbbae00/0x5564f2c20ac0bd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0bce expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.407593:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac0bf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0bf1 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.407600:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.407637:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac0bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0bf1 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.407762:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac0bf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0bf1 expref: 16 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100445.407778:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960614528:0@lo:104: 00000100:00100000:3.0:1786100445.407914:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786100445.407966:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4fbbae00/0x5564f2c20ac0bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0bce expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.407975:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c4fbbae00/0x5564f2c20ac0bd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0bce expref: 16 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100445.407983:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960614656:0@lo:104: 00010000:00010000:3.0:1786100445.408005:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c41510e00/0x5564f2c20ac0bb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0bb2 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.408012:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c41510e00/0x5564f2c20ac0bb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0bb2 expref: 16 pid: 5838 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100445.408189:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1786100445.408209:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100445.408269:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960614528 00000100:00100000:2.0:1786100445.408275:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960614528 00000100:00100000:3.0:1786100445.408327:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960614784:0@lo:104: 00000100:00100000:3.0:1786100445.408362:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786100445.408619:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0b8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0b88 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.408629:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0b8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0b88 expref: 16 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100445.408637:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960614912:0@lo:104: 00000100:00100000:3.0:1786100445.408681:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100445.408803:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960614656 00000100:00100000:1.0:1786100445.408808:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960614656 00000100:00100000:1.0:1786100445.408830:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960614784 00000100:00100000:1.0:1786100445.408832:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960614784 00000100:00100000:1.0:1786100445.408845:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786100445.408853:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c484ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:5838:x1872861960614528:12345-0@lo:104: 00010000:00010000:1.0:1786100445.408865:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0bf8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.408922:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786100445.408928:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c484ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:5838:x1872861960614528:12345-0@lo:104: Request processed in 76us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100445.408935:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786100445.408972:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786100445.408979:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:5838:x1872861960614656:12345-0@lo:104: 00010000:00010000:1.0:1786100445.408987:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0bd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409017:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1786100445.409022:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:5838:x1872861960614656:12345-0@lo:104: Request processed in 45us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100445.409040:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786100445.409062:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786100445.409078:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:5838:x1872861960614784:12345-0@lo:104: 00010000:00010000:1.0:1786100445.409085:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0bb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409110:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1786100445.409115:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:5838:x1872861960614784:12345-0@lo:104: Request processed in 39us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100445.409120:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1786100445.409138:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786100445.409144:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0bf8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409151:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e000 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:1.0:1786100445.409156:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0bf8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409165:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0bf8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786100445.409173:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0bf8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100445.409178:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786100445.409205:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0bf8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409211:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786100445.409230:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0bf8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409247:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e000/0x5564f2c20ac0bf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0bf8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409261:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786100445.409264:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0bd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409270:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba200 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:1.0:1786100445.409273:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0bd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409279:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0bd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786100445.409285:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0bd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100445.409290:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786100445.409304:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0bd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409311:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786100445.409325:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0bd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409331:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac0bce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0bd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409341:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100445.409365:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0bb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409370:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386800 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:1.0:1786100445.409373:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0bb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409379:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0bb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786100445.409384:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0bb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100445.409389:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786100445.409402:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0bb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409407:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786100445.409413:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0bb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409418:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0bb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0bb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409428:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100445.409429:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100445.409431:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100445.409463:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960615040:0@lo:103: 00000100:00100000:1.0:1786100445.409492:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100445.409536:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960615168:0@lo:103: 00000100:00100000:1.0:1786100445.409567:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100445.409585:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786100445.409591:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960615296:0@lo:103: 00000100:00100000:1.0:1786100445.409610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100445.409637:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960615040 00000100:00100000:1.0:1786100445.409640:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960615040 00010000:00010000:1.0:1786100445.409676:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac0bf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0bf1 expref: 17 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100445.409689:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960615168 00000100:00100000:1.0:1786100445.409692:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960615168 00010000:00010000:1.0:1786100445.409703:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4fbbae00/0x5564f2c20ac0bd5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0bce expref: 18 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100445.409713:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960615296 00000100:00100000:1.0:1786100445.409716:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960615296 00010000:00010000:1.0:1786100445.409724:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c41510e00/0x5564f2c20ac0bb9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0bb2 expref: 19 pid: 5838 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100445.409735:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786100445.409740:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960615040:12345-0@lo:103: 00010000:00010000:1.0:1786100445.409748:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100445.409753:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac0bf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0bf1 expref: 19 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409763:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac0bf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0bf1 expref: 19 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409779:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100445.409817:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960615040:12345-0@lo:103: Request processed in 76us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100445.409832:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786100445.409845:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786100445.409851:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:3305:x1872861960615168:12345-0@lo:103: 00010000:00010000:1.0:1786100445.409858:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100445.409862:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4fbbae00/0x5564f2c20ac0bd5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0bce expref: 18 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409870:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4fbbae00/0x5564f2c20ac0bd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0bce expref: 18 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409880:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100445.409906:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:3305:x1872861960615168:12345-0@lo:103: Request processed in 55us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100445.409912:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786100445.409924:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786100445.409931:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:3305:x1872861960615296:12345-0@lo:103: 00010000:00010000:1.0:1786100445.409938:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100445.409942:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c41510e00/0x5564f2c20ac0bb9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0bb2 expref: 17 pid: 5838 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409950:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c41510e00/0x5564f2c20ac0bb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0bb2 expref: 17 pid: 5838 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.409958:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100445.409979:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:3305:x1872861960615296:12345-0@lo:103: Request processed in 49us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100445.409985:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786100445.410019:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960615040:0@lo:103: 00000100:00100000:1.0:1786100445.410047:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960615296:0@lo:103: 00000100:00100000:1.0:1786100445.410053:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960615168:0@lo:103: 00010000:00010000:0.0:1786100445.410325:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100445.411502:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0b5e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.411517:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0b65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0b5e expref: 16 pid: 5838 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100445.411529:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960615424:0@lo:104: 00000100:00100000:3.0:1786100445.411570:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100445.411833:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734c00 going to sleep for 11 seconds 00010000:00010000:3.0:1786100445.411854:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac0bf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0bf1 expref: 16 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100445.411864:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960614528:0@lo:104: 00010000:00010000:3.0:1786100445.411873:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbbae00/0x5564f2c20ac0bd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0bce expref: 15 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100445.411880:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960614656:0@lo:104: 00010000:00010000:3.0:1786100445.411888:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c41510e00/0x5564f2c20ac0bb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0bb2 expref: 14 pid: 5838 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100445.411905:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960614784:0@lo:104: 00000100:00100000:1.0:1786100445.412011:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960614912 00000100:00100000:1.0:1786100445.412017:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960614912 00000100:00100000:1.0:1786100445.412168:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960615424 00000100:00100000:1.0:1786100445.412172:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960615424 00000100:00100000:1.0:1786100445.412186:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786100445.412194:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:5838:x1872861960614912:12345-0@lo:104: 00010000:00010000:1.0:1786100445.412206:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0b8f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.412316:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786100445.412323:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:5838:x1872861960614912:12345-0@lo:104: Request processed in 129us (3642us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100445.412329:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786100445.412441:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960614912:0@lo:104: 00000100:00100000:1.0:1786100445.412538:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786100445.412549:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:5838:x1872861960615424:12345-0@lo:104: 00010000:00010000:1.0:1786100445.412556:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0b65 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100445.412631:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1872861960615424:0@lo:104: 00010000:00010000:3.0:1786100445.412675:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.412783:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786100445.412789:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0b8f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.412808:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165ec00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100445.412813:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0b8f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.412836:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0b8f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100445.412843:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0b8f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100445.412848:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786100445.412998:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b8f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.413006:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100445.413038:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b8f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.413055:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac0b88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b8f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.413068:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100445.413071:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0b65 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.413077:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fc00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100445.413080:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0b65 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.413085:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0b65 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100445.413091:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0b65 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100445.413101:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1786100445.413139:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960615552:0@lo:103: 00000100:00100000:2.0:1786100445.413176:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786100445.413553:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1786100445.413561:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:5838:x1872861960615424:12345-0@lo:104: Request processed in 1015us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100445.413569:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786100445.413594:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960615552 00000100:00100000:1.0:1786100445.413598:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960615552 00010000:00010000:1.0:1786100445.413617:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0b8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0b88 expref: 14 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100445.413672:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786100445.413680:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:3307:x1872861960615552:12345-0@lo:103: 00010000:00010000:1.0:1786100445.413690:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100445.413696:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0b8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0b88 expref: 14 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.413706:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0b8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0b88 expref: 14 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.413720:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0b8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0b88 expref: 14 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.413733:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100445.413765:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:3307:x1872861960615552:12345-0@lo:103: Request processed in 86us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100445.413772:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786100445.413811:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960615552:0@lo:103: 00010000:00010000:0.0:1786100445.413979:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b65 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.413986:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100445.414004:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b65 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.414011:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac0b5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b65 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100445.414185:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786100445.414195:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960615680:0@lo:103: 00000100:00100000:1.0:1786100445.414224:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100445.414293:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960615680 00000100:00100000:3.0:1786100445.414298:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960615680 00010000:00010000:3.0:1786100445.414315:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0b65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0b5e expref: 13 pid: 5838 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100445.414340:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786100445.414355:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:3307:x1872861960615680:12345-0@lo:103: 00010000:00010000:3.0:1786100445.414378:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100445.414384:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0b65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0b5e expref: 13 pid: 5838 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414393:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0b5e expref: 13 pid: 5838 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414404:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0b65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0b5e expref: 13 pid: 5838 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414415:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414423:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414573:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414581:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414588:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414594:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414600:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c41511600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100445.414604:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414611:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414626:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414635:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100445.414692:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:3307:x1872861960615680:12345-0@lo:103: Request processed in 345us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100445.414700:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1786100445.414722:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414730:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.414743:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c14 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1786100445.414755:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1786100445.414869:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960615680:0@lo:103: 00010000:00010000:0.0:1786100445.415039:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100445.415042:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100445.420023:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100445.424267:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100445.519728:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:7619:x1872861960614400:12345-0@lo:253: Request processed in 127753us (128412us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100445.519744:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786100445.520003:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960614400:0@lo:253: 10000000:01000000:0.0:1786100445.520027:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1786100445.520030:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786100445.520032:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786100445.520034:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786100445.520035:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1786100445.520036:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786100445.520038:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786100445.520039:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786100445.520041:0:7619:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1786100445.520042:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786100445.520044:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1786100445.520126:0:7619:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a3c7f9ee000 from lustre-OST0001 10000000:01000000:0.0:1786100445.520150:0:7619:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1786100445.520153:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1786100445.520161:0:7619:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a3c44f34d40 local copy 10000000:01000000:0.0:1786100445.520166:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786100445.520212:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.520223:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.520232:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100445.520251:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960615808:0@lo:101: 00000100:00100000:0.0:1786100445.520288:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100445.520417:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b670c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100445.520675:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960615808 00000100:00100000:3.0:1786100445.520682:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960615808 00000100:00100000:3.0:1786100445.520725:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786100445.520733:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:7619:x1872861960615808:12345-0@lo:101: 00010000:00010000:3.0:1786100445.520745:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100445.520758:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0c1b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.520777:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0c1b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.520786:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0c1b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.520860:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c41511600, rc 0) 00000100:00100000:3.0:1786100445.520903:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:7619:x1872861960615808:12345-0@lo:101: Request processed in 170us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100445.520910:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786100445.521179:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960615808:0@lo:101: 00010000:00010000:0.0:1786100445.521192:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5564f2c20ac0c22 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.521202:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5564f2c20ac0c22 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100445.521295:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960615936:0@lo:501: 00000100:00100000:0.0:1786100445.521322:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100445.521361:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b670c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100445.521525:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960615936 00000100:00100000:3.0:1786100445.521529:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960615936 00000100:00100000:3.0:1786100445.521598:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786100445.521615:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:7619:x1872861960615936:12345-0@lo:501: 00000100:00100000:3.0:1786100445.521857:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:7619:x1872861960615936:12345-0@lo:501: Request processed in 242us (533us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786100445.521863:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786100445.521940:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960615936:0@lo:501: 10000000:01000000:0.0:1786100445.521953:0:7619:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1786100445.521979:0:7619:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1786100445.521985:0:7619:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5564f2c20ac0c22 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.521993:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5564f2c20ac0c22 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.522005:0:7619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5564f2c20ac0c22 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.522036:0:7619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100445.523915:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100445.523926:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5564f2c20ac0c22 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.523937:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb400 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:1.0:1786100445.523955:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5564f2c20ac0c22 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.523965:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5564f2c20ac0c22 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786100445.523972:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5564f2c20ac0c22 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100445.523977:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786100445.524010:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5564f2c20ac0c22 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.524016:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786100445.524040:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5564f2c20ac0c22 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.524057:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb400/0x5564f2c20ac0c1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5564f2c20ac0c22 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.524076:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100445.524078:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100445.524080:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100445.524096:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960616064:0@lo:103: 00000100:00100000:1.0:1786100445.524145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1786100445.526624:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a3c7f9ee000 10000000:01000000:0.0:1786100445.526637:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1786100445.526644:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1786100445.526647:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786100445.526665:0:7619:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1786100445.526668:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1786100445.526708:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.526718:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.526728:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100445.526750:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616192:0@lo:101: 00000100:00100000:0.0:1786100445.526823:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100445.531917:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960616064 00000100:00100000:1.0:1786100445.531932:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960616064 00000100:00100000:1.0:1786100445.531996:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786100445.532005:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:3305:x1872861960616064:12345-0@lo:103: 00010000:00010000:1.0:1786100445.532020:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100445.532062:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c41511600/0x5564f2c20ac0c22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0c1b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.532083:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100445.532156:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:3305:x1872861960616064:12345-0@lo:103: Request processed in 152us (8010us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100445.532164:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786100445.532204:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960616064:0@lo:103: 00000100:00100000:0.0:1786100445.537328:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100445.539973:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960616192 00000100:00100000:2.0:1786100445.539988:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960616192 00000100:00100000:2.0:1786100445.540059:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1786100445.540069:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+11:7619:x1872861960616192:12345-0@lo:101: 00010000:00010000:2.0:1786100445.540085:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100445.540105:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0c30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0c29 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100445.540131:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0c29 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100445.540141:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0c29 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100445.540149:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0ba00, rc 0) 00000100:00100000:2.0:1786100445.540223:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:7619:x1872861960616192:12345-0@lo:101: Request processed in 155us (13399us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100445.540246:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1786100445.541562:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616192:0@lo:101: 00010000:00010000:0.0:1786100445.541584:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c30 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.541596:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0c30 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100445.541735:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616320:0@lo:501: 00000100:00100000:0.0:1786100445.541809:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100445.541842:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100445.542481:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960616320 00000100:00100000:2.0:1786100445.542489:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960616320 00000100:00100000:2.0:1786100445.542528:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1786100445.542537:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:7619:x1872861960616320:12345-0@lo:501: 00000100:00100000:2.0:1786100445.543006:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:7619:x1872861960616320:12345-0@lo:501: Request processed in 468us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100445.543015:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786100445.543573:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616320:0@lo:501: 00000100:00100000:0.0:1786100445.543621:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616448:0@lo:503: 00000100:00100000:0.0:1786100445.543699:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100445.543727:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100445.543804:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960616448 00000100:00100000:3.0:1786100445.543810:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960616448 00000100:00100000:3.0:1786100445.543851:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1786100445.543859:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:7619:x1872861960616448:12345-0@lo:503: 00000100:00100000:3.0:1786100445.544558:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:7619:x1872861960616448:12345-0@lo:503: Request processed in 698us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100445.544567:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786100445.544722:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616448:0@lo:503: 00000040:00080000:0.0:1786100445.545027:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786100445.545101:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616576:0@lo:502: 00000100:00100000:0.0:1786100445.545143:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100445.545179:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100445.545370:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960616576 00000100:00100000:3.0:1786100445.545375:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960616576 00000100:00100000:3.0:1786100445.545415:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1786100445.545423:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:7619:x1872861960616576:12345-0@lo:502: 00000100:00100000:3.0:1786100445.545737:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:7619:x1872861960616576:12345-0@lo:502: Request processed in 313us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100445.545745:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1786100445.545790:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616576:0@lo:502: 00000040:00080000:3.0:1786100445.546566:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1786100445.546619:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1786100445.546688:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1786100445.546752:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1786100445.547119:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1786100445.547166:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1786100445.547202:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616704:0@lo:502: 00000100:00100000:3.0:1786100445.547259:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100445.547355:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734480 going to sleep for 11 seconds 00000100:00100000:1.0:1786100445.549530:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960616704 00000100:00100000:1.0:1786100445.549543:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960616704 00000100:00100000:0.0:1786100445.551999:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786100445.552025:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:7619:x1872861960616704:12345-0@lo:502: 00000100:00100000:0.0:1786100445.552595:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:7619:x1872861960616704:12345-0@lo:502: Request processed in 580us (5333us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100445.552604:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786100445.566560:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616704:0@lo:502: 00000040:00080000:2.0:1786100445.570160:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1786100445.570183:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1786100445.572257:0:7625:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786100445.572269:0:7625:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1786100445.572277:0:7625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100445.572279:0:7625:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1786100445.572286:0:7625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786100445.572321:0:7625:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a3c7fa50000) 00000020:00000080:0.0:1786100445.572630:0:7625:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1786100445.572639:0:7625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1786100445.572729:0:7625:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a3c7f9ee000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1786100445.572738:0:7625:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1786100445.572744:0:7625:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5564f2c20ac0c3e 00010000:00010000:0.0:1786100445.578767:0:7625:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1786100445.579634:0:7625:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1786100445.583121:0:7625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1786100445.583414:0:7625:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1786100445.589157:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1786100445.590769:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1786100445.592158:0:7625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1786100445.592170:0:7625:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100445.592176:0:7625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100445.592178:0:7625:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1786100445.592181:0:7625:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100445.592185:0:7625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100445.592186:0:7625:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786100445.592189:0:7625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786100445.592190:0:7625:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1786100445.592236:0:7625:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100445.592240:0:7625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100445.592241:0:7625:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1786100445.592244:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1786100445.597747:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1786100445.598148:0:7619:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1786100445.598174:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c30 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.598187:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c30 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100445.598196:0:7619:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c7f9ee000 from 1 10000000:01000000:3.0:1786100445.598199:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786100445.598305:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.598314:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.598325:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100445.598346:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616832:0@lo:101: 00000100:00100000:3.0:1786100445.598414:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100445.598461:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960616832 00000100:00100000:3.0:1786100445.598468:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960616832 00000100:00100000:3.0:1786100445.598518:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786100445.598527:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:7619:x1872861960616832:12345-0@lo:101: 00010000:00010000:3.0:1786100445.598539:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100445.598551:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0c4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0c45 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.598588:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0c45 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.598597:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0c45 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.598604:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c41511000, rc 0) 00000100:00100000:3.0:1786100445.598635:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7619:x1872861960616832:12345-0@lo:101: Request processed in 109us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100445.598641:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786100445.598709:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734480 going to sleep for 11 seconds 00000100:00100000:3.0:1786100445.598730:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616832:0@lo:101: 00010000:00010000:3.0:1786100445.598741:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c4c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100445.598750:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0c4c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100445.599418:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616960:0@lo:501: 00000100:00100000:3.0:1786100445.599448:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100445.599481:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734480 going to sleep for 11 seconds 00000100:00100000:1.0:1786100445.599537:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960616960 00000100:00100000:1.0:1786100445.599543:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960616960 00000100:00100000:1.0:1786100445.599583:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786100445.599590:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7619:x1872861960616960:12345-0@lo:501: 00000100:00100000:1.0:1786100445.599840:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7619:x1872861960616960:12345-0@lo:501: Request processed in 249us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100445.599847:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1786100445.599934:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960616960:0@lo:501: 00000100:00100000:3.0:1786100445.599962:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617088:0@lo:503: 00000100:00100000:3.0:1786100445.599999:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100445.600702:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734480 going to sleep for 11 seconds 00000100:00100000:1.0:1786100445.603916:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960617088 00000100:00100000:1.0:1786100445.603928:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960617088 00000100:00100000:1.0:1786100445.603981:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786100445.603991:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7619:x1872861960617088:12345-0@lo:503: 00000100:00100000:1.0:1786100445.604423:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7619:x1872861960617088:12345-0@lo:503: Request processed in 432us (4422us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100445.604431:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1786100445.604608:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617088:0@lo:503: 00000040:00080000:2.0:1786100445.604926:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786100445.604995:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617216:0@lo:502: 00000100:00100000:2.0:1786100445.605038:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100445.605071:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c450c5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786100445.605427:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960617216 00000100:00100000:1.0:1786100445.605433:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960617216 00000100:00100000:1.0:1786100445.605535:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1786100445.605544:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7619:x1872861960617216:12345-0@lo:502: 00000100:00100000:1.0:1786100445.605836:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7619:x1872861960617216:12345-0@lo:502: Request processed in 293us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100445.605844:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1786100445.606413:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617216:0@lo:502: 00000040:00080000:1.0:1786100445.607016:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1786100445.607074:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1786100445.607108:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617344:0@lo:502: 00000100:00100000:1.0:1786100445.607160:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100445.607205:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74940f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786100445.607257:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960617344 00000100:00100000:2.0:1786100445.607262:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960617344 00000100:00100000:2.0:1786100445.607304:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1786100445.607313:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7619:x1872861960617344:12345-0@lo:502: 00000100:00100000:2.0:1786100445.607547:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7619:x1872861960617344:12345-0@lo:502: Request processed in 234us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100445.607554:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1786100445.608934:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617344:0@lo:502: 00000040:00080000:2.0:1786100445.609206:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1786100445.609225:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1786100445.609921:0:7629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786100445.609930:0:7629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100445.609932:0:7629:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1786100445.609946:0:7629:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a3c7f9ee000 00000020:00000080:2.0:1786100445.609948:0:7629:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786100445.609970:0:7629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100445.609973:0:7629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100445.609974:0:7629:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1786100445.609977:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1786100445.610047:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1786100445.610078:0:7619:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786100445.610136:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c4c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.610147:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c4c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100445.610189:0:7619:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1786100445.610197:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a3c7f9ee000 10000000:01000000:1.0:1786100445.610200:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a3c7f9ee000 10000000:01000000:1.0:1786100445.610204:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786100445.610209:0:7619:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a3c7f9ee000 from 1 10000000:01000000:1.0:1786100445.610211:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786100445.610240:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.610249:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.610258:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100445.610284:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617472:0@lo:101: 00000100:00100000:1.0:1786100445.610338:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100445.610448:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c749400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100445.610500:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960617472 00000100:00100000:2.0:1786100445.610508:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960617472 00000100:00100000:2.0:1786100445.610595:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1786100445.610607:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7619:x1872861960617472:12345-0@lo:101: 00010000:00010000:2.0:1786100445.610619:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100445.610630:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0b800/0x5564f2c20ac0c5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0c53 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100445.610672:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0b800/0x5564f2c20ac0c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0c53 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100445.610682:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0b800/0x5564f2c20ac0c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0c53 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100445.610690:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0b800, rc 0) 00000100:00100000:2.0:1786100445.610734:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7619:x1872861960617472:12345-0@lo:101: Request processed in 130us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100445.610740:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1786100445.610922:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617472:0@lo:101: 00010000:00010000:1.0:1786100445.610936:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c5a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.610945:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0c5a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100445.611027:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617600:0@lo:501: 00000100:00100000:1.0:1786100445.611055:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100445.611073:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c749400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100445.611111:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960617600 00000100:00100000:2.0:1786100445.611115:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960617600 00000100:00100000:2.0:1786100445.611146:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1786100445.611152:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7619:x1872861960617600:12345-0@lo:501: 00000100:00100000:1.0:1786100445.611522:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617600:0@lo:501: 00000100:00100000:1.0:1786100445.611548:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617728:0@lo:503: 00000100:00100000:1.0:1786100445.611585:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100445.611641:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7619:x1872861960617600:12345-0@lo:501: Request processed in 488us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100445.611687:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1786100445.611734:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c749400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100445.611868:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960617728 00000100:00100000:2.0:1786100445.611872:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960617728 00000100:00100000:3.0:1786100445.611942:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1786100445.611952:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7619:x1872861960617728:12345-0@lo:503: 00000100:00100000:3.0:1786100445.612092:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7619:x1872861960617728:12345-0@lo:503: Request processed in 142us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100445.612099:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1786100445.612212:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617728:0@lo:503: 00000040:00080000:1.0:1786100445.612529:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786100445.612591:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617856:0@lo:502: 00000100:00100000:1.0:1786100445.612626:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100445.612684:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c749400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100445.612972:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960617856 00000100:00100000:0.0:1786100445.612977:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960617856 00000100:00100000:0.0:1786100445.613015:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1786100445.613023:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7619:x1872861960617856:12345-0@lo:502: 00000100:00100000:0.0:1786100445.613202:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7619:x1872861960617856:12345-0@lo:502: Request processed in 179us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100445.613209:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1786100445.613459:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617856:0@lo:502: 00000040:00080000:1.0:1786100445.613754:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1786100445.613835:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1786100445.613873:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1786100445.613921:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1786100445.613961:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1786100445.614021:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1786100445.614059:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1786100445.614094:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1786100445.614141:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1786100445.614178:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1786100445.614211:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1786100445.614259:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1786100445.614297:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1786100445.614332:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1786100445.614534:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1786100445.614569:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1786100445.614598:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1786100445.614633:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1786100445.614691:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1786100445.614718:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1786100445.614756:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1786100445.614784:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1786100445.614821:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1786100445.614858:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1786100445.614893:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1786100445.614928:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1786100445.614976:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1786100445.615011:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1786100445.615043:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1786100445.615091:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1786100445.615142:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1786100445.615178:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1786100445.615208:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1786100445.615268:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1786100445.615314:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1786100445.615785:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1786100445.615890:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1786100445.615934:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617984:0@lo:502: 00000100:00100000:1.0:1786100445.616003:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100445.616078:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c749400c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100445.616123:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960617984 00000100:00100000:3.0:1786100445.616131:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960617984 00000100:00100000:3.0:1786100445.616181:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1786100445.616190:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7619:x1872861960617984:12345-0@lo:502: 00000100:00100000:3.0:1786100445.616543:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7619:x1872861960617984:12345-0@lo:502: Request processed in 353us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100445.616551:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1786100445.616616:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960617984:0@lo:502: 00000040:00080000:1.0:1786100445.616839:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1786100445.616850:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1786100445.617521:0:7630:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1786100445.617538:0:7630:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a3c7c018000) 00000020:00000080:3.0:1786100445.617558:0:7630:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1786100445.618012:0:7630:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a3c7f9ee000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1786100445.618017:0:7630:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a3c7f9ee000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1786100445.618019:0:7630:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a3c7f9ee000 3 00010000:00080000:3.0:1786100445.618047:0:7630:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a3b411ec000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.153@tcp at head 00010000:00010000:3.0:1786100445.619628:0:7630:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1786100445.619744:0:7630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1786100445.619777:0:7630:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786100445.619787:0:7630:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5564f2c20ac0c68 00000100:00080000:3.0:1786100445.619806:0:7630:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786100445.619811:0:7630:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a3b411ec000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:3.0:1786100445.619841:0:7630:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3c7ba2f480 x1872861960618112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786100445.619872:0:7630:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1786100445.619969:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960618240:0@lo:400: 00000100:00100000:3.0:1786100445.620027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100445.620074:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960618368:0@lo:400: 00000100:00100000:3.0:1786100445.620097:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100445.620116:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786100445.620122:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960618496:0@lo:400: 00000100:00100000:3.0:1786100445.620148:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100445.620178:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960618240 00000100:00100000:3.0:1786100445.620184:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960618240 00000100:00100000:3.0:1786100445.620212:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960618368 00000100:00100000:3.0:1786100445.620215:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960618368 00000100:00100000:3.0:1786100445.620241:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786100445.620249:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960618240:12345-0@lo:400: 00000100:00100000:3.0:1786100445.620296:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960618240:12345-0@lo:400: Request processed in 47us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100445.620303:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786100445.620315:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786100445.620321:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960618368:12345-0@lo:400: 00000100:00100000:3.0:1786100445.620349:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960618368:12345-0@lo:400: Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100445.620355:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786100445.620376:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960618496 00000100:00100000:3.0:1786100445.620379:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960618496 00000100:00100000:3.0:1786100445.620403:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786100445.620409:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960618496:12345-0@lo:400: 00000100:00100000:0.0:1786100445.622360:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1872861960618112:0@lo:38: 00000100:00100000:0.0:1786100445.623168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100445.623473:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960618112 00000100:00100000:2.0:1786100445.623483:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960618112 00000100:00100000:2.0:1786100445.623527:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786100445.623535:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1872861960618112:12345-0@lo:38: 00010000:00080000:2.0:1786100445.623564:0:5843:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:2.0:1786100445.623599:0:5843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5564f2c20ac0c6f 00000004:00100000:2.0:1786100445.623613:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786100445.623644:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9a3c7bf13800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786100445.623742:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1872861960618112:12345-0@lo:38: Request processed in 206us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100445.623750:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1786100445.623907:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c7ba2f480 x1872861960618112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786100455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100445.623920:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786100445.623938:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1786100445.623947:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1786100445.623951:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1786100445.623953:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3b411ec000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1786100445.623959:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1872861960618112:0@lo:38: 00000040:00080000:2.0:1786100445.625754:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1786100445.625954:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1786100445.625981:0:7619:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786100445.626003:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c5a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.626014:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c5a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786100445.626060:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786100445.626062:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786100445.626064:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786100445.626065:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786100445.626065:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786100445.626067:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786100445.626068:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786100445.626069:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786100445.626071:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786100445.626072:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786100445.626073:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786100445.626077:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1786100445.626079:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786100445.626080:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786100445.626081:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786100445.626083:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786100445.626088:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786100445.626089:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786100445.626090:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786100445.626091:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786100445.626092:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786100445.626093:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786100445.626094:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786100445.626116:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1786100445.626132:0:7619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960618624:0@lo:253: 00000100:00100000:1.0:1786100445.626191:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100445.626224:0:7619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74940000 going to sleep for 11 seconds 00000100:00100000:1.0:1786100445.626274:0:7632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7632:1872861960618752:0@lo:901: 00000100:00100000:1.0:1786100445.626317:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100445.626340:0:7632:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c51e77600 going to sleep for 11 seconds 00000100:00100000:2.0:1786100445.627477:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960618624 00000100:00100000:2.0:1786100445.627487:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960618624 00000100:00100000:2.0:1786100445.627539:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1786100445.627556:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7619:x1872861960618624:12345-0@lo:253: 20000000:01000000:2.0:1786100445.627584:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1786100445.627597:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1786100445.628710:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786100445.628718:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786100445.628759:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c7ba2e680 x1872861960618368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100445.628775:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960618368:0@lo:400: 00010000:00080000:1.0:1786100445.628831:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c7ba2f800 x1872861960618240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100445.628841:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960618240:0@lo:400: 00010000:00080000:2.0:1786100445.629457:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c7ba2df80 x1872861960618496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100445.629468:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960618496:0@lo:400: 00000100:00100000:3.0:1786100445.629520:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960618496:12345-0@lo:400: Request processed in 9034us (9295us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100445.629533:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786100445.629572:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960618752 00000100:00100000:3.0:1786100445.629578:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960618752 00000100:00100000:3.0:1786100445.629634:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786100445.629642:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7632:x1872861960618752:12345-0@lo:901: 00000100:00080000:2.0:1786100445.629695:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100445.630311:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7632:x1872861960618752:12345-0@lo:901: Request processed in 667us (3991us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100445.630320:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1786100445.630375:0:7632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c745b3100 x1872861960618752/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1786100461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100445.630386:0:7632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7632:1872861960618752:0@lo:901: 20000000:01000000:2.0:1786100445.647442:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1786100445.647525:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1786100445.647621:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786100445.647626:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786100445.647647:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.647697:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0bc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0bc0 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.647705:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.647757:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0bc0 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100445.647771:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0bc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0bc0 expref: 14 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100445.647786:0:5859:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1872861960618880:0@lo:104: 00000100:00100000:1.0:1786100445.648002:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100445.648148:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960618880 00000100:00100000:2.0:1786100445.648155:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960618880 00000100:00100000:2.0:1786100445.648200:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786100445.648284:0:5859:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c50c593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100445.648326:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:5859:x1872861960618880:12345-0@lo:104: 00010000:00010000:2.0:1786100445.648343:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0bc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100445.648533:0:5859:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1872861960618880:0@lo:104: 00010000:00010000:1.0:1786100445.648552:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100445.648590:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786100445.648597:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:5859:x1872861960618880:12345-0@lo:104: Request processed in 389us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100445.648604:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1786100445.648627:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100445.648632:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0bc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100445.648639:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c41510c00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:2.0:1786100445.648643:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0bc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100445.648722:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0bc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786100445.648740:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0bc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100445.648746:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1786100445.648824:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0bc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100445.648831:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786100445.649010:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0bc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100445.649073:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960619008:0@lo:103: 00000100:00100000:3.0:1786100445.649113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100445.649414:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960619008 00000100:00100000:0.0:1786100445.649420:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960619008 00010000:00010000:0.0:1786100445.649444:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0bc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0bc0 expref: 15 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100445.649471:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786100445.649479:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:3305:x1872861960619008:12345-0@lo:103: 00010000:00010000:0.0:1786100445.649491:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100445.649496:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0bc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0bc0 expref: 15 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.649506:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0bc0 expref: 15 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.649522:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0bc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0bc0 expref: 15 pid: 5837 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.649536:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.649544:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786100445.649558:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006888211s 00010000:00010000:0.0:1786100445.649562:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.649568:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.649588:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.649593:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.649598:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100445.649602:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.649609:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.649623:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.649633:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100445.649697:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:3305:x1872861960619008:12345-0@lo:103: Request processed in 219us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100445.649703:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786100445.649764:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960619008:0@lo:103: 00010000:00010000:0.0:1786100445.649781:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100445.649788:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100445.650773:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0bc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0bc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100445.650801:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100445.650804:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100445.650806:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100445.651079:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62386400/0x5564f2c20ac0c76 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100445.678715:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:7619:x1872861960618624:12345-0@lo:253: Request processed in 51151us (52514us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100445.678729:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1786100445.678970:0:7619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28d1ade7-51d1-4427-9c4d-d62141c5468b:7619:1872861960618624:0@lo:253: 10000000:01000000:1.0:1786100445.678986:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1786100445.678989:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786100445.678991:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786100445.678992:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786100445.678994:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786100445.678995:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786100445.678996:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786100445.678997:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786100445.678998:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786100445.679000:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786100445.679001:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786100445.679003:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786100445.679018:0:7619:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1786100445.699118:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1786100445.699296:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1786100445.699482:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1786100445.699687:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1786100445.699939:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1786100445.700193:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1786100445.707324:0:7619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1786100445.935591:0:7619:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1786100445.935598:0:7619:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1786100445.935625:0:7619:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1786100445.935712:0:7619:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1786100445.935737:0:7619:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1786100445.935763:0:7619:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1786100446.373221:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100447.142540:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786100447.142577:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960619136:0@lo:13: 00000100:00100000:3.0:1786100447.142685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100447.142766:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960619136 00000100:00100000:3.0:1786100447.142777:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960619136 00000100:00100000:3.0:1786100447.142846:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786100447.142856:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960619136:12345-0@lo:13: 00002000:00000024:3.0:1786100447.142897:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100447.142945:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960619136:12345-0@lo:13: Request processed in 90us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100447.142952:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1786100447.142981:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786100447.143015:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7ba2d180 x1872861960619136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100447.143037:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960619136:0@lo:13: 00010000:00010000:1.0:1786100447.397297:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100448.424679:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100449.455181:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100450.469800:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100450.724925:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960619392:0@lo:400: 00000100:00100000:0.0:1786100450.724994:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100450.725052:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786100450.725059:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960619264:0@lo:400: 00000100:00100000:0.0:1786100450.725086:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100450.725110:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960619776:0@lo:400: 00000100:00100000:0.0:1786100450.725147:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100450.725174:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960619520:0@lo:400: 00000100:00100000:0.0:1786100450.725196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100450.725215:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786100450.725220:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960619648:0@lo:400: 00000100:00100000:0.0:1786100450.725249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100450.725280:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960619264 00000100:00100000:0.0:1786100450.725286:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960619264 00000100:00100000:0.0:1786100450.725335:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1786100450.725344:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:3308:x1872861960619264:12345-0@lo:400: 00000100:00100000:0.0:1786100450.725393:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:3308:x1872861960619264:12345-0@lo:400: Request processed in 50us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100450.725400:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1786100450.725431:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960619392 00000100:00100000:0.0:1786100450.725435:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960619392 00000100:00100000:0.0:1786100450.725451:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960619776 00000100:00100000:0.0:1786100450.725463:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960619776 00000100:00100000:0.0:1786100450.725487:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960619520 00000100:00100000:0.0:1786100450.725490:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960619520 00000100:00100000:0.0:1786100450.725505:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786100450.725511:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960619392:12345-0@lo:400: 00000100:00100000:0.0:1786100450.725545:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960619392:12345-0@lo:400: Request processed in 34us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100450.725551:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786100450.725563:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786100450.725569:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960619776:12345-0@lo:400: 00000100:00100000:0.0:1786100450.725598:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960619776:12345-0@lo:400: Request processed in 30us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100450.725604:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786100450.725614:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1786100450.725620:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960619520:12345-0@lo:400: 00000100:00100000:0.0:1786100450.725681:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960619520:12345-0@lo:400: Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100450.725688:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1786100450.725707:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786100450.725731:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c44f79c00 x1872861960619520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100450.725745:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960619520:0@lo:400: 00000100:00100000:0.0:1786100450.725798:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960619264:0@lo:400: 00010000:00080000:0.0:1786100450.725807:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c44f78700 x1872861960619776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100450.725815:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960619776:0@lo:400: 00010000:00080000:0.0:1786100450.725833:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c44f7a680 x1872861960619392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100450.725841:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960619392:0@lo:400: 00000100:00100000:2.0:1786100450.726099:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960619648 00000100:00100000:2.0:1786100450.726105:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960619648 00000100:00100000:2.0:1786100450.726151:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786100450.726160:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960619648:12345-0@lo:400: 00000100:00100000:2.0:1786100450.726203:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960619648:12345-0@lo:400: Request processed in 46us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100450.726209:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1786100450.726227:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786100450.726244:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c44f78a80 x1872861960619648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100450.726266:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960619648:0@lo:400: 00010000:00010000:1.0:1786100451.497291:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1786100451.752474:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786100451.752481:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a3c6e163000 from 30 10000000:01000000:2.0:1786100451.752485:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786100451.752523:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.752534:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.752544:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100451.752565:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960619904:0@lo:101: 00000100:00100000:2.0:1786100451.752621:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.752685:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323180 going to sleep for 11 seconds 00000100:00100000:0.0:1786100451.752749:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960619904 00000100:00100000:0.0:1786100451.752765:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960619904 00000100:00100000:0.0:1786100451.752825:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1786100451.752834:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:5840:x1872861960619904:12345-0@lo:101: 00010000:00010000:0.0:1786100451.752846:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100451.752858:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbba600/0x5564f2c20ac0c84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0c7d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100451.752880:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbba600/0x5564f2c20ac0c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0c7d expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100451.752891:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbba600/0x5564f2c20ac0c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0c7d expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100451.752899:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbba600, rc 0) 00000100:00100000:0.0:1786100451.752941:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960619904:12345-0@lo:101: Request processed in 104us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100451.752949:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1786100451.754994:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960619904:0@lo:101: 00010000:00010000:2.0:1786100451.755018:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.755030:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0c84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100451.755097:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960620032:0@lo:501: 00000100:00100000:2.0:1786100451.755145:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.755182:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323180 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.758160:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960620032 00000100:00100000:2.0:1786100451.758188:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960620032 00000100:00100000:2.0:1786100451.758246:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1786100451.758256:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960620032:12345-0@lo:501: 00000100:00100000:2.0:1786100451.758629:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960620032:12345-0@lo:501: Request processed in 375us (3483us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.758637:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1786100451.758702:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960620032:0@lo:501: 00000100:00100000:2.0:1786100451.758744:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960620160:0@lo:503: 00000100:00100000:2.0:1786100451.758801:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.758830:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323180 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.758842:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960620160 00000100:00100000:2.0:1786100451.758846:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960620160 00000100:00100000:2.0:1786100451.758868:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786100451.758874:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960620160:12345-0@lo:503: 00000100:00100000:2.0:1786100451.759119:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960620160:12345-0@lo:503: Request processed in 244us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.759126:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786100451.759159:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960620160:0@lo:503: 00000100:00100000:2.0:1786100451.759316:0:7945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7945:1872861960620288:0@lo:502: 00000100:00100000:2.0:1786100451.759349:0:7945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.759368:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960620288 00000100:00100000:2.0:1786100451.759371:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960620288 00000100:00100000:2.0:1786100451.759393:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1786100451.759399:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7945:x1872861960620288:12345-0@lo:502: 00000100:00100000:2.0:1786100451.759584:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7945:x1872861960620288:12345-0@lo:502: Request processed in 184us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.759599:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1786100451.759626:0:7945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323000 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.759638:0:7945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7945:1872861960620288:0@lo:502: 00000100:00100000:2.0:1786100451.759696:0:7945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7945:1872861960620416:0@lo:502: 00000100:00100000:2.0:1786100451.759727:0:7945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.759744:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960620416 00000100:00100000:2.0:1786100451.759748:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960620416 00000100:00100000:2.0:1786100451.759785:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1786100451.759794:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7945:x1872861960620416:12345-0@lo:502: 00000100:00100000:2.0:1786100451.759910:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:7945:x1872861960620416:12345-0@lo:502: Request processed in 118us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.759916:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1786100451.759943:0:7945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323000 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.759955:0:7945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7945:1872861960620416:0@lo:502: 00000040:00080000:2.0:1786100451.759972:0:7945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1786100451.760019:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1786100451.760033:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786100451.760041:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.760051:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100451.760061:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1786100451.760064:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1786100451.760067:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1786100451.760088:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.760102:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.760111:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100451.760125:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960620544:0@lo:101: 00000100:00100000:2.0:1786100451.760153:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.760166:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323000 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.760179:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960620544 00000100:00100000:2.0:1786100451.760183:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960620544 00000100:00100000:2.0:1786100451.760206:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1786100451.760212:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960620544:12345-0@lo:101: 00010000:00010000:2.0:1786100451.760220:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100451.760230:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0c92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0c8b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.760250:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0c8b expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.760260:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0c8b expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.760267:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0ae00, rc 0) 00000100:00100000:2.0:1786100451.760292:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960620544:12345-0@lo:101: Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.760298:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1786100451.760325:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960620544:0@lo:101: 00010000:00010000:2.0:1786100451.760343:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.760351:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0c92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100451.760389:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960620672:0@lo:501: 00000100:00100000:2.0:1786100451.760414:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.760428:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323000 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.760439:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960620672 00000100:00100000:2.0:1786100451.760442:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960620672 00000100:00100000:2.0:1786100451.760463:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1786100451.760469:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960620672:12345-0@lo:501: 00000100:00100000:2.0:1786100451.760669:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960620672:12345-0@lo:501: Request processed in 178us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.760677:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1786100451.760709:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960620672:0@lo:501: 00000100:00100000:2.0:1786100451.760733:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960620800:0@lo:503: 00000100:00100000:2.0:1786100451.760783:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.760797:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323000 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.760807:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960620800 00000100:00100000:2.0:1786100451.760811:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960620800 00000100:00100000:2.0:1786100451.760831:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1786100451.760837:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960620800:12345-0@lo:503: 00000100:00100000:2.0:1786100451.769487:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960620800:12345-0@lo:503: Request processed in 8642us (8695us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.769501:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1786100451.769854:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960620800:0@lo:503: 00000100:00100000:2.0:1786100451.770226:0:7947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7947:1872861960620928:0@lo:502: 00000100:00100000:2.0:1786100451.770277:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.770360:0:7947:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323900 going to sleep for 11 seconds 00000100:00100000:1.0:1786100451.770460:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960620928 00000100:00100000:1.0:1786100451.770466:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960620928 00000100:00100000:1.0:1786100451.770585:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1786100451.770596:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:7947:x1872861960620928:12345-0@lo:502: 00000100:00100000:1.0:1786100451.770975:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:7947:x1872861960620928:12345-0@lo:502: Request processed in 381us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100451.770983:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1786100451.771065:0:7947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7947:1872861960620928:0@lo:502: 00000020:01000000:2.0:1786100451.771090:0:7947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786100451.771098:0:7947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100451.771101:0:7947:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786100451.771105:0:7947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786100451.771107:0:7947:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1786100451.771126:0:7947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7947:1872861960621056:0@lo:502: 00000100:00100000:2.0:1786100451.771161:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.771183:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960621056 00000100:00100000:2.0:1786100451.771186:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960621056 00000100:00100000:2.0:1786100451.771210:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1786100451.771217:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:7947:x1872861960621056:12345-0@lo:502: 00000100:00100000:2.0:1786100451.771328:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:7947:x1872861960621056:12345-0@lo:502: Request processed in 110us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.772550:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1786100451.772604:0:7947:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323900 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.772690:0:7947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7947:1872861960621056:0@lo:502: 00000020:01000000:2.0:1786100451.772722:0:7947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100451.772727:0:7947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100451.772729:0:7947:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1786100451.772733:0:7947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1786100451.774772:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1786100451.774802:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1786100451.774813:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100451.774825:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0c92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100451.774834:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786100451.774849:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a3c47abb000 from 30 10000000:01000000:1.0:1786100451.774852:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786100451.774885:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100451.774892:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100451.774902:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100451.774923:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960621184:0@lo:101: 00000100:00100000:1.0:1786100451.774984:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100451.775036:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.775240:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960621184 00000100:00100000:2.0:1786100451.775247:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960621184 00000100:00100000:2.0:1786100451.775304:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1786100451.775313:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960621184:12345-0@lo:101: 00010000:00010000:2.0:1786100451.775333:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100451.775346:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0bc00/0x5564f2c20ac0ca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0c99 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.775367:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0bc00/0x5564f2c20ac0ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0c99 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.775377:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0bc00/0x5564f2c20ac0ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0c99 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.775385:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0bc00, rc 0) 00000100:00100000:2.0:1786100451.775424:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960621184:12345-0@lo:101: Request processed in 112us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.775430:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1786100451.775468:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960621184:0@lo:101: 00010000:00010000:2.0:1786100451.775480:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ca0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.775488:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0ca0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100451.775532:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960621312:0@lo:501: 00000100:00100000:2.0:1786100451.775556:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.775568:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b423236c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.775578:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960621312 00000100:00100000:2.0:1786100451.775581:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960621312 00000100:00100000:2.0:1786100451.775599:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1786100451.775605:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960621312:12345-0@lo:501: 00000100:00100000:2.0:1786100451.775876:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960621312:12345-0@lo:501: Request processed in 270us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.775882:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1786100451.776186:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960621312:0@lo:501: 00000100:00100000:3.0:1786100451.776220:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960621440:0@lo:503: 00000100:00100000:3.0:1786100451.776328:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100451.776352:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.776463:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960621440 00000100:00100000:2.0:1786100451.776468:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960621440 00000100:00100000:2.0:1786100451.776502:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1786100451.776509:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960621440:12345-0@lo:503: 00000100:00100000:2.0:1786100451.777558:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960621440:12345-0@lo:503: Request processed in 1042us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.777567:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1786100451.779414:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960621440:0@lo:503: 00000100:00100000:3.0:1786100451.779929:0:7948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7948:1872861960621568:0@lo:502: 00000100:00100000:3.0:1786100451.780020:0:7948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100451.780061:0:7948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d7340c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100451.780234:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960621568 00000100:00100000:1.0:1786100451.780241:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960621568 00000100:00100000:1.0:1786100451.780296:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1786100451.780311:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:7948:x1872861960621568:12345-0@lo:502: 00000100:00100000:1.0:1786100451.780558:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:7948:x1872861960621568:12345-0@lo:502: Request processed in 253us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100451.780566:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1786100451.780797:0:7948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7948:1872861960621568:0@lo:502: 00000100:00100000:3.0:1786100451.780856:0:7948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7948:1872861960621696:0@lo:502: 00000100:00100000:3.0:1786100451.780894:0:7948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100451.780918:0:7948:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d7340c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.781049:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960621696 00000100:00100000:2.0:1786100451.781054:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960621696 00000100:00100000:2.0:1786100451.781089:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1786100451.781104:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:7948:x1872861960621696:12345-0@lo:502: 00000100:00100000:2.0:1786100451.781263:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:7948:x1872861960621696:12345-0@lo:502: Request processed in 166us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.781270:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1786100451.781396:0:7948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7948:1872861960621696:0@lo:502: 00000040:00080000:1.0:1786100451.781418:0:7948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1786100451.781625:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1786100451.781643:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786100451.781698:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ca0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.781708:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ca0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100451.781719:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1786100451.781722:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a3c47abb000 from 5 10000000:01000000:2.0:1786100451.781725:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1786100451.781772:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.781780:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.781789:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100451.781803:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960621824:0@lo:101: 00000100:00100000:2.0:1786100451.781837:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100451.782172:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960621824 00000100:00100000:1.0:1786100451.782178:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960621824 00000100:00100000:1.0:1786100451.782215:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1786100451.782223:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960621824:12345-0@lo:101: 00010000:00010000:1.0:1786100451.782241:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100451.782256:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c62387200/0x5564f2c20ac0cae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0ca7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100451.782304:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323000 going to sleep for 11 seconds 00010000:00010000:1.0:1786100451.782351:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62387200/0x5564f2c20ac0cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0ca7 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100451.782363:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c62387200/0x5564f2c20ac0cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0ca7 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100451.782372:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62387200, rc 0) 00000100:00100000:1.0:1786100451.782416:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960621824:12345-0@lo:101: Request processed in 193us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100451.782423:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1786100451.783215:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960621824:0@lo:101: 00010000:00010000:2.0:1786100451.783232:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.783242:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100451.783293:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960621952:0@lo:256: 00000100:00100000:2.0:1786100451.783335:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.783364:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323000 going to sleep for 11 seconds 00000100:00100000:3.0:1786100451.788754:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960621952 00000100:00100000:3.0:1786100451.788850:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960621952 00000100:00100000:3.0:1786100451.788919:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1786100451.788932:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960621952:12345-0@lo:256: 20000000:01000000:3.0:1786100451.788958:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1786100451.788986:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786100451.788990:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1786100451.789124:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960621952:12345-0@lo:256: Request processed in 195us (5787us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100451.789131:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1786100451.790907:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960621952:0@lo:256: 10000000:01000000:2.0:1786100451.790968:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786100451.790978:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.790989:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100451.791007:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1786100451.791011:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1786100451.791013:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1786100451.791051:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.791059:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.791069:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100451.791091:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960622080:0@lo:101: 00000100:00100000:2.0:1786100451.791603:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.791735:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323000 going to sleep for 11 seconds 00000100:00100000:3.0:1786100451.795622:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960622080 00000100:00100000:3.0:1786100451.795963:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960622080 00000100:00100000:2.0:1786100451.805279:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1786100451.805296:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960622080:12345-0@lo:101: 00010000:00010000:2.0:1786100451.805317:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100451.805334:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0cbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0cb5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.805363:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0cb5 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.805375:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0cb5 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.805385:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0a400, rc 0) 00000100:00100000:2.0:1786100451.805464:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960622080:12345-0@lo:101: Request processed in 173us (13861us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.805472:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1786100451.805868:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960622080:0@lo:101: 00010000:00010000:2.0:1786100451.805890:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0cbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.805902:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0cbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100451.805965:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960622208:0@lo:501: 00000100:00100000:2.0:1786100451.806002:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.806038:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323000 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.806057:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960622208 00000100:00100000:2.0:1786100451.806063:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960622208 00000100:00100000:2.0:1786100451.806093:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1786100451.806101:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960622208:12345-0@lo:501: 00000100:00100000:2.0:1786100451.806354:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960622208:12345-0@lo:501: Request processed in 252us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.806361:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1786100451.806392:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960622208:0@lo:501: 00000100:00100000:2.0:1786100451.806419:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960622336:0@lo:503: 00000100:00100000:2.0:1786100451.806458:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.806473:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323000 going to sleep for 11 seconds 00000100:00100000:3.0:1786100451.806631:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960622336 00000100:00100000:3.0:1786100451.806636:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960622336 00000100:00100000:3.0:1786100451.806679:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1786100451.806687:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960622336:12345-0@lo:503: 00000100:00100000:3.0:1786100451.807017:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960622336:12345-0@lo:503: Request processed in 329us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100451.807025:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1786100451.807210:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960622336:0@lo:503: 00000100:00100000:2.0:1786100451.807417:0:7952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7952:1872861960622464:0@lo:502: 00000100:00100000:2.0:1786100451.807459:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.807496:0:7952:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b423230c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100451.807605:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960622464 00000100:00100000:3.0:1786100451.807609:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960622464 00000100:00100000:3.0:1786100451.807643:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1786100451.807685:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:7952:x1872861960622464:12345-0@lo:502: 00000100:00100000:3.0:1786100451.807972:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:7952:x1872861960622464:12345-0@lo:502: Request processed in 321us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100451.807979:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1786100451.811019:0:7952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7952:1872861960622464:0@lo:502: 00000020:01000000:1.0:1786100451.811068:0:7952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786100451.811077:0:7952:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1786100451.811083:0:7952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100451.811085:0:7952:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1786100451.811091:0:7952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1786100451.811095:0:7952:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.153@tcp to nid 0x20000c0a8ce99 (192.168.206.153@tcp) 00000020:01000000:1.0:1786100451.811133:0:7952:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1786100451.811137:0:7952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786100451.811153:0:7952:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a3c7f4f3380) 00000020:00000080:1.0:1786100451.811175:0:7952:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1786100451.811180:0:7952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1786100451.811257:0:7952:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1786100451.811264:0:7952:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1786100451.811271:0:7952:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac0cca 00010000:00080000:1.0:1786100451.811448:0:7952:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a3c4737d000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.153@tcp at head 00010000:00010000:1.0:1786100451.811715:0:7952:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1786100451.818789:0:7952:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1786100451.818810:0:7952:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1786100451.822846:0:7952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786100451.823223:0:7952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786100451.823285:0:7952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1786100451.823366:0:7952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1786100451.824449:0:7954:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786100451.824456:0:7954:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1786100451.825338:0:7952:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786100451.825350:0:7952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1786100451.825382:0:7952:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1786100451.825403:0:7952:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5564f2c20ac0cd1 00000100:00080000:1.0:1786100451.825413:0:7952:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1786100451.825419:0:7952:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a3c4737d000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:1.0:1786100451.825451:0:7952:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3c745b3100 x1872861960622592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786100451.825476:0:7952:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1786100451.825641:0:7952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786100451.825646:0:7952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100451.825673:0:7952:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1786100451.825678:0:7952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786100451.825683:0:7952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100451.825684:0:7952:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1786100451.825687:0:7952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1786100451.825689:0:7952:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1786100451.825718:0:7952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7952:1872861960622720:0@lo:502: 00000100:00100000:1.0:1786100451.825802:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100451.825836:0:7952:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.826076:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960622592:0@lo:8: 00000100:00100000:2.0:1786100451.826116:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.826160:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960622720 00000100:00100000:2.0:1786100451.826166:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960622720 00000100:00100000:2.0:1786100451.826208:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1786100451.826217:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:7952:x1872861960622720:12345-0@lo:502: 00000100:00100000:2.0:1786100451.826442:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:7952:x1872861960622720:12345-0@lo:502: Request processed in 225us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.826449:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1786100451.826801:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960622592 00000100:00100000:1.0:1786100451.826805:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960622592 00000100:00100000:1.0:1786100451.826847:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786100451.826852:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1872861960622592:12345-0@lo:8: 00010000:00080000:1.0:1786100451.826874:0:6686:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:1.0:1786100451.826896:0:6686:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5564f2c20ac0cd8 00002000:00100000:1.0:1786100451.826908:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a3c4514f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1786100451.826911:0:6686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1786100451.826915:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1786100451.827018:0:6686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1786100451.827151:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1786100451.827173:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9a3c4514d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786100451.827215:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1872861960622592:12345-0@lo:8: Request processed in 362us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100451.827223:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786100451.827258:0:7952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:7952:1872861960622720:0@lo:502: 00000020:01000000:1.0:1786100451.827285:0:7952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786100451.827291:0:7952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100451.827294:0:7952:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1786100451.827298:0:7952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1786100451.829406:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1786100451.829432:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1786100451.829442:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0cbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.829454:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0cbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100451.829464:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1786100451.829467:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a3c44f34d40 from 1 10000000:01000000:2.0:1786100451.829469:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786100451.829513:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.829521:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.829532:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100451.829565:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960622848:0@lo:101: 00000100:00100000:2.0:1786100451.829623:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.829689:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47013000 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.829705:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960622848 00000100:00100000:2.0:1786100451.829711:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960622848 00000100:00100000:2.0:1786100451.829748:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1786100451.829768:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960622848:12345-0@lo:101: 00010000:00010000:2.0:1786100451.829779:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100451.829791:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0a800/0x5564f2c20ac0ce6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0cdf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.829812:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0a800/0x5564f2c20ac0ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0cdf expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.829822:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0a800/0x5564f2c20ac0ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0cdf expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.829831:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0a800, rc 0) 00000100:00100000:2.0:1786100451.829866:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960622848:12345-0@lo:101: Request processed in 110us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.829874:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1786100451.829931:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745b3100 x1872861960622592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786100461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100451.829943:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786100451.829953:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1786100451.829964:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1786100451.829971:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1786100451.829984:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c4737d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1786100451.829999:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1786100451.830008:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960622592:0@lo:8: 00000100:00100000:2.0:1786100451.830400:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960623104:0@lo:400: 00000100:00100000:2.0:1786100451.831280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.831357:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960622848:0@lo:101: 00010000:00010000:2.0:1786100451.831379:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ce6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.831389:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0ce6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100451.831450:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960623232:0@lo:501: 00000100:00100000:2.0:1786100451.831482:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.831512:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47013000 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.831528:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960623232 00000100:00100000:2.0:1786100451.831534:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960623232 00000100:00100000:1.0:1786100451.831598:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960623104 00000100:00100000:1.0:1786100451.831603:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960623104 00000100:00100000:2.0:1786100451.833080:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1786100451.833092:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960623232:12345-0@lo:501: 00000100:00100000:2.0:1786100451.833345:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960623232:12345-0@lo:501: Request processed in 254us (1861us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786100451.833353:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1786100451.833410:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960623232:0@lo:501: 10000000:01000000:2.0:1786100451.833440:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1786100451.833449:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ce6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100451.833470:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ce6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786100451.836626:0:7954:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1786100451.836875:0:7954:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 193079223259ns, next at 0ns, rc = 0 00000100:00100000:3.0:1786100451.836909:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786100451.836933:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960622976:0@lo:400: 00000100:00100000:3.0:1786100451.837008:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.838204:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960623360:0@lo:400: 00000100:00100000:2.0:1786100451.838258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.838308:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960623360 00000100:00100000:2.0:1786100451.838314:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960623360 00000100:00100000:2.0:1786100451.838359:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786100451.838368:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960623360:12345-0@lo:400: 00000100:00100000:2.0:1786100451.838420:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960623360:12345-0@lo:400: Request processed in 53us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.838427:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1786100451.838469:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d3800 x1872861960623360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100451.838495:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960623360:0@lo:400: 00000100:00100000:2.0:1786100451.838535:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786100451.838544:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960623488:0@lo:400: 00000100:00100000:1.0:1786100451.841297:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960622976 00000100:00100000:1.0:1786100451.841309:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960622976 00000100:00100000:1.0:1786100451.841481:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786100451.841493:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960623104:12345-0@lo:400: 00000100:00100000:1.0:1786100451.842018:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960623104:12345-0@lo:400: Request processed in 526us (10738us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100451.842025:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786100451.842055:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786100451.842062:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960622976:12345-0@lo:400: 00000100:00100000:1.0:1786100451.842103:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960622976:12345-0@lo:400: Request processed in 42us (5096us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100451.842109:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786100451.842293:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1786100451.842357:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7ba2d500 x1872861960622976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100451.842371:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960622976:0@lo:400: 00000100:00100000:3.0:1786100451.842396:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960623488 00000100:00100000:3.0:1786100451.842408:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960623488 00000100:00100000:3.0:1786100451.842433:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786100451.842439:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960623488:12345-0@lo:400: 00000100:00100000:3.0:1786100451.842497:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960623488:12345-0@lo:400: Request processed in 56us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100451.842504:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1786100451.842533:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d3800 x1872861960623488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100451.842543:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960623488:0@lo:400: 00010000:00080000:3.0:1786100451.843169:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7ba2fb80 x1872861960623104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100451.843180:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960623104:0@lo:400: 00000004:00080000:3.0:1786100451.888861:0:7955:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1786100451.888892:0:7955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7955:1872861960623744:0@lo:7: 00000100:00100000:3.0:1786100451.888960:0:7955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100451.889009:0:7955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c60253540 going to sleep for 11 seconds 00000100:00100000:3.0:1786100451.889024:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786100451.889035:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960623616:0@lo:13: 00000100:00100000:3.0:1786100451.889060:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100451.889090:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960623616 00000100:00100000:3.0:1786100451.889096:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960623616 00000100:00100000:3.0:1786100451.889146:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786100451.889155:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872861960623616:12345-0@lo:13: 00002000:00000024:3.0:1786100451.889185:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1786100451.889228:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872861960623616:12345-0@lo:13: Request processed in 74us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100451.889246:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1786100451.889286:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7ba2fb80 x1872861960623616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100451.889304:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960623616:0@lo:13: 00000100:00100000:2.0:1786100451.889618:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960623744 00000100:00100000:2.0:1786100451.889623:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960623744 00000100:00100000:2.0:1786100451.889674:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786100451.889681:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7955:x1872861960623744:12345-0@lo:7: 00000100:00080000:3.0:1786100451.893805:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1786100451.911419:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1786100451.911427:0:6683:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1786100451.913933:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7955:x1872861960623744:12345-0@lo:7: Request processed in 24245us (24965us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100451.913957:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1786100451.914097:0:7955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7ba2d500 x1872861960623744/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1786100467 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100451.914112:0:7955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7955:1872861960623744:0@lo:7: 00000004:00080000:2.0:1786100451.914124:0:7955:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1786100451.914162:0:7955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7955:1872861960623872:0@lo:5: 00000100:00100000:2.0:1786100451.914209:0:7955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.914244:0:7955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c601af300 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.914257:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960623872 00000100:00100000:2.0:1786100451.914262:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960623872 00000100:00100000:2.0:1786100451.914294:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786100451.914300:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7955:x1872861960623872:12345-0@lo:5: 00002000:00080000:2.0:1786100451.914322:0:6686:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1786100451.914326:0:6686:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1786100451.914558:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7955:x1872861960623872:12345-0@lo:5: Request processed in 257us (348us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1786100451.914564:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1786100451.914586:0:7955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d0700 x1872861960623872/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786100467 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100451.914596:0:7955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7955:1872861960623872:0@lo:5: 00000004:00080000:2.0:1786100451.914603:0:7955:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1786100451.914622:0:7955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7955:1872861960624000:0@lo:700: 00000100:00100000:2.0:1786100451.914968:0:7955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.915027:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960624000 00000100:00100000:2.0:1786100451.915030:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960624000 00000100:00100000:2.0:1786100451.915061:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786100451.915065:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7955:x1872861960624000:12345-0@lo:700: 00000100:00100000:2.0:1786100451.915090:0:6692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6692:1872861960624128:0@lo:700: 00000100:00100000:2.0:1786100451.915115:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100451.915132:0:6692:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c601af180 going to sleep for 11 seconds 00000100:00100000:2.0:1786100451.915148:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960624128 00000100:00100000:2.0:1786100451.915151:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960624128 00000100:00100000:2.0:1786100451.915176:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786100451.915182:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6692:x1872861960624128:12345-0@lo:700: 00000100:00100000:2.0:1786100451.915540:0:7955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c601af300 going to sleep for 11 seconds 00000004:00080000:1.0:1786100451.940861:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1786100451.989881:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1786100451.998966:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6692:x1872861960624128:12345-0@lo:700: Request processed in 83776us (83841us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100451.998981:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1786100451.999035:0:6692:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d1180 x1872861960624128/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1786100467 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100451.999050:0:6692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6692:1872861960624128:0@lo:700: 40000000:02000000:1.0:1786100451.999063:0:6692:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:02000400:3.0:1786100452.077604:0:7981:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1786100452.098225:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7955:x1872861960624000:12345-0@lo:700: Request processed in 183149us (183246us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100452.098242:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:3.0:1786100452.098287:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1786100452.098301:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:2.0:1786100452.098317:0:7955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d2a00 x1872861960624000/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1786100467 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100452.098334:0:7955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7955:1872861960624000:0@lo:700: 00000004:02000040:2.0:1786100452.127463:0:7955:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1786100452.136948:0:7955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7955:1872861960624256:0@lo:5: 00000100:00100000:2.0:1786100452.137011:0:7955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100452.137047:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960624256 00000100:00100000:2.0:1786100452.137053:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960624256 00000100:00100000:2.0:1786100452.137097:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786100452.137106:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7955:x1872861960624256:12345-0@lo:5: 00000100:00100000:3.0:1786100452.141909:0:7955:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67480 going to sleep for 11 seconds 00002000:00080000:2.0:1786100452.146081:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1786100452.146725:0:6686:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1786100452.155854:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7955:x1872861960624256:12345-0@lo:5: Request processed in 18742us (18837us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1786100452.155867:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1786100452.155899:0:7955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d2a00 x1872861960624256/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786100468 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100452.155913:0:7955:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1786100452.155926:0:7955:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a3c745d2a00 x1872861960624256/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786100468 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100452.155936:0:7955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7955:1872861960624256:0@lo:5: 00000004:00080000:3.0:1786100452.155948:0:7955:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1786100452.264788:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960624384:0@lo:13: 00000100:00100000:3.0:1786100452.264854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100452.264922:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960624384 00000100:00100000:3.0:1786100452.264929:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960624384 00000100:00100000:3.0:1786100452.264978:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786100452.264987:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960624384:12345-0@lo:13: 00002000:00000024:3.0:1786100452.265018:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100452.265060:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960624384:12345-0@lo:13: Request processed in 74us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100452.265081:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1786100452.265104:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786100452.265133:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7ba2fb80 x1872861960624384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100452.265150:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960624384:0@lo:13: 00010000:00010000:1.0:1786100452.517196:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100453.541273:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100454.565241:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100455.590397:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100456.613309:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100456.869295:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960624896:0@lo:400: 00000100:00100000:2.0:1786100456.869392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100456.869460:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786100456.869467:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960624512:0@lo:400: 00000100:00100000:2.0:1786100456.869502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100456.870020:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960625024:0@lo:400: 00000100:00100000:2.0:1786100456.870055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100456.870092:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960624640:0@lo:400: 00000100:00100000:2.0:1786100456.870114:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100456.870132:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960625152:0@lo:400: 00000100:00100000:2.0:1786100456.870153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100456.870176:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786100456.870181:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960624768:0@lo:400: 00000100:00100000:2.0:1786100456.870201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100456.870238:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960624896 00000100:00100000:2.0:1786100456.870245:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960624896 00000100:00100000:2.0:1786100456.870305:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960625152 00000100:00100000:2.0:1786100456.870309:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960625152 00000100:00100000:2.0:1786100456.870330:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786100456.870341:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960624896:12345-0@lo:400: 00000100:00100000:2.0:1786100456.870406:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960624896:12345-0@lo:400: Request processed in 66us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100456.870413:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786100456.870431:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786100456.870438:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1872861960625152:12345-0@lo:400: 00000100:00100000:2.0:1786100456.870469:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1872861960625152:12345-0@lo:400: Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100456.870483:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786100456.870504:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960624512 00000100:00100000:2.0:1786100456.870508:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960624512 00000100:00100000:2.0:1786100456.872445:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1786100456.872470:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3305:x1872861960624512:12345-0@lo:400: 00000100:00100000:1.0:1786100456.874702:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960625024 00000100:00100000:1.0:1786100456.874721:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960625024 00000100:00100000:1.0:1786100456.874847:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960624640 00000100:00100000:1.0:1786100456.874851:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960624640 00000100:00100000:1.0:1786100456.874866:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960624768 00000100:00100000:1.0:1786100456.874869:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960624768 00000100:00100000:1.0:1786100456.874889:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786100456.875098:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3305:x1872861960624512:12345-0@lo:400: Request processed in 2637us (5591us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100456.875111:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1786100456.875161:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786100456.875167:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786100456.875171:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786100456.875829:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1872861960625024:12345-0@lo:400: 00000100:00100000:1.0:1786100456.875984:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1872861960625024:12345-0@lo:400: Request processed in 1004us (5851us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100456.875993:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786100456.876020:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786100456.876030:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960624640:12345-0@lo:400: 00000100:00100000:1.0:1786100456.876068:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960624640:12345-0@lo:400: Request processed in 39us (5952us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100456.876073:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786100456.876084:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786100456.876090:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960624768:12345-0@lo:400: 00000100:00100000:1.0:1786100456.876118:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960624768:12345-0@lo:400: Request processed in 29us (5916us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100456.876124:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1786100456.878478:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d3800 x1872861960624768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100456.878504:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960624768:0@lo:400: 00010000:00080000:2.0:1786100456.878521:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d1180 x1872861960624640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100456.878530:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960624640:0@lo:400: 00010000:00080000:2.0:1786100456.878543:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c74f0d500 x1872861960625152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100456.878552:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960625152:0@lo:400: 00000100:00100000:2.0:1786100456.878601:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960624512:0@lo:400: 00010000:00080000:2.0:1786100456.878614:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d0e00 x1872861960625024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100456.878624:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960625024:0@lo:400: 00010000:00080000:2.0:1786100456.878674:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d0a80 x1872861960624896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100456.878684:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960624896:0@lo:400: 00000001:00080000:1.0:1786100457.107569:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1786100457.384133:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786100457.384159:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960625280:0@lo:13: 00000100:00100000:2.0:1786100457.384222:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100457.384285:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960625408:0@lo:13: 00000100:00100000:2.0:1786100457.384310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100457.384385:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960625280 00000100:00100000:3.0:1786100457.384393:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960625280 00000100:00100000:3.0:1786100457.384430:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960625408 00000100:00100000:3.0:1786100457.384432:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960625408 00000100:00100000:3.0:1786100457.384447:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786100457.384455:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960625280:12345-0@lo:13: 00002000:00000024:3.0:1786100457.384487:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100457.384580:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960625280:12345-0@lo:13: Request processed in 124us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100457.384588:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786100457.384605:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786100457.384614:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960625408:12345-0@lo:13: 00002000:00000024:3.0:1786100457.384636:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100457.384706:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960625408:12345-0@lo:13: Request processed in 93us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100457.384713:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1786100457.384761:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c74f0c700 x1872861960625408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100457.384780:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960625408:0@lo:13: 00010000:00080000:2.0:1786100457.386476:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c74f0d500 x1872861960625280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100457.386488:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1786100457.386508:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960625280:0@lo:13: 00000100:00100000:3.0:1786100457.569935:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100457.571484:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941727360 00000100:00100000:2.0:1786100457.571495:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941727360 00000100:00100000:2.0:1786100457.571580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 111 00000100:00100000:2.0:1786100457.571588:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1872861941727360:12345-192.168.206.53@tcp:250: 00010000:00080000:2.0:1786100457.571614:0:5837:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 9d69173c-d092-48de-a520-1459f9171aec@192.168.206.53@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:2.0:1786100457.571639:0:5837:0:(genops.c:1406:class_connect()) connect: client 9d69173c-d092-48de-a520-1459f9171aec, cookie 0x5564f2c20ac0ced 00000100:00080000:2.0:1786100457.571811:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9a3c7bf10800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786100457.571883:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+5:2350:x1872861941727360:12345-192.168.206.53@tcp:250: Request processed in 293us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100457.571891:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 111 00000100:00100000:3.0:1786100457.581319:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100457.581466:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941727488 00000100:00100000:0.0:1786100457.581475:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941727488 00000100:00100000:0.0:1786100457.581531:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 112 00000100:00100000:0.0:1786100457.581541:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+5:5578:x1872861941727488:12345-192.168.206.53@tcp:101: 00010000:00010000:0.0:1786100457.581557:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100457.581576:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac0cf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2d9f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100457.581610:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac0cf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2d9f expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100457.581623:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac0cf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2d9f expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100457.581632:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb400, rc 0) 00000100:00100000:0.0:1786100457.581706:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+6:5578:x1872861941727488:12345-192.168.206.53@tcp:101: Request processed in 166us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100457.581714:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 112 00000100:00100000:1.0:1786100457.587413:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100457.587556:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941727616 00000100:00100000:3.0:1786100457.587565:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941727616 00000100:00100000:3.0:1786100457.587609:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 113 00000100:00100000:3.0:1786100457.587619:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+6:5578:x1872861941727616:12345-192.168.206.53@tcp:501: 00000100:00100000:3.0:1786100457.587920:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+6:5578:x1872861941727616:12345-192.168.206.53@tcp:501: Request processed in 300us (515us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786100457.587929:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 113 00000100:00100000:3.0:1786100457.592095:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100457.592178:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941727744 00000100:00100000:2.0:1786100457.592186:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941727744 00000100:00100000:2.0:1786100457.592237:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 114 00000100:00100000:2.0:1786100457.592255:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+6:5578:x1872861941727744:12345-192.168.206.53@tcp:101: 00010000:00010000:2.0:1786100457.592271:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100457.592297:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0a000/0x5564f2c20ac0cfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2da6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100457.592322:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0a000/0x5564f2c20ac0cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2da6 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100457.592333:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0a000/0x5564f2c20ac0cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2da6 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100457.592342:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0a000, rc 0) 00000100:00100000:2.0:1786100457.592389:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+7:5578:x1872861941727744:12345-192.168.206.53@tcp:101: Request processed in 136us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100457.592396:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 114 00000100:00100000:2.0:1786100457.595617:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100457.595690:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941727872 00000100:00100000:0.0:1786100457.595699:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941727872 00000100:00100000:0.0:1786100457.595759:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:0.0:1786100457.595769:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+7:5578:x1872861941727872:12345-192.168.206.53@tcp:501: 00000100:00100000:0.0:1786100457.596038:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+8:5578:x1872861941727872:12345-192.168.206.53@tcp:501: Request processed in 270us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100457.596047:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:3.0:1786100457.599401:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100457.601955:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941728000 00000100:00100000:2.0:1786100457.601969:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941728000 00000100:00100000:2.0:1786100457.602029:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:2.0:1786100457.602039:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+8:5578:x1872861941728000:12345-192.168.206.53@tcp:503: 00000100:00100000:2.0:1786100457.602378:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+8:5578:x1872861941728000:12345-192.168.206.53@tcp:503: Request processed in 339us (3107us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100457.602386:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:3.0:1786100457.605257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100457.608624:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941728128 00000100:00100000:1.0:1786100457.608636:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941728128 00000100:00100000:1.0:1786100457.608739:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00100000:1.0:1786100457.608750:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+8:5597:x1872861941728128:12345-192.168.206.53@tcp:502: 00000100:00100000:1.0:1786100457.609066:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+8:5597:x1872861941728128:12345-192.168.206.53@tcp:502: Request processed in 317us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100457.609074:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00100000:2.0:1786100457.630182:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100457.630260:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941728256 00000100:00100000:0.0:1786100457.630270:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941728256 00000100:00100000:0.0:1786100457.630324:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 118 00000100:00100000:0.0:1786100457.630335:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+8:5597:x1872861941728256:12345-192.168.206.53@tcp:502: 00000100:00100000:0.0:1786100457.630633:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+8:5597:x1872861941728256:12345-192.168.206.53@tcp:502: Request processed in 299us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100457.630642:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 118 00010000:00010000:3.0:1786100457.639255:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100457.639320:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100457.640255:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941728384 00000100:00100000:0.0:1786100457.640274:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941728384 00000100:00100000:0.0:1786100457.640330:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 119 00000100:00100000:0.0:1786100457.640340:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+8:5578:x1872861941728384:12345-192.168.206.53@tcp:101: 00010000:00010000:0.0:1786100457.640357:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100457.640374:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0d02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2dd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100457.640401:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2dd0 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100457.640413:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2dd0 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100457.640422:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbaa00, rc 0) 00000100:00100000:0.0:1786100457.640480:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+9:5578:x1872861941728384:12345-192.168.206.53@tcp:101: Request processed in 141us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100457.640488:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 119 00000100:00100000:1.0:1786100457.643666:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100457.643760:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941728512 00000100:00100000:3.0:1786100457.643768:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941728512 00000100:00100000:3.0:1786100457.643819:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 120 00000100:00100000:3.0:1786100457.643828:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+9:5578:x1872861941728512:12345-192.168.206.53@tcp:256: 20000000:01000000:3.0:1786100457.643852:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1786100457.643875:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1786100457.643880:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1786100457.643884:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1786100457.643886:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1786100457.649046:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+9:5578:x1872861941728512:12345-192.168.206.53@tcp:256: Request processed in 5209us (5395us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100457.649060:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 120 00000100:00100000:1.0:1786100457.656110:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100457.656143:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941728640 00000100:00100000:1.0:1786100457.656160:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941728640 00000100:00100000:1.0:1786100457.656207:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:1.0:1786100457.656216:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+9:5578:x1872861941728640:12345-192.168.206.53@tcp:101: 00010000:00010000:1.0:1786100457.656232:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100457.656249:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0d09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2dd7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100457.657432:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0d09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2dd7 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100457.657455:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0d09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2dd7 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100457.657466:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386e00, rc 0) 00000100:00100000:0.0:1786100457.659177:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+10:5578:x1872861941728640:12345-192.168.206.53@tcp:101: Request processed in 2953us (3067us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100457.659189:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:3.0:1786100457.662830:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100457.662973:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941728768 00000100:00100000:0.0:1786100457.662983:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941728768 00000100:00100000:0.0:1786100457.663041:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 122 00000100:00100000:0.0:1786100457.663051:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+10:5578:x1872861941728768:12345-192.168.206.53@tcp:501: 00000100:00100000:0.0:1786100457.663379:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+10:5578:x1872861941728768:12345-192.168.206.53@tcp:501: Request processed in 329us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100457.663387:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 122 00000100:00100000:1.0:1786100457.670040:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100457.670259:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941728896 00000100:00100000:0.0:1786100457.670347:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941728896 00000100:00100000:0.0:1786100457.670400:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 123 00000100:00100000:0.0:1786100457.670410:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:5578:x1872861941728896:12345-192.168.206.53@tcp:503: 00000100:00100000:0.0:1786100457.670911:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:5578:x1872861941728896:12345-192.168.206.53@tcp:503: Request processed in 499us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100457.670919:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 123 00000100:00100000:0.0:1786100457.676828:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100457.676861:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941729024 00000100:00100000:0.0:1786100457.676870:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941729024 00000100:00100000:0.0:1786100457.676917:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 124 00000100:00100000:0.0:1786100457.676926:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+10:5602:x1872861941729024:12345-192.168.206.53@tcp:502: 00000100:00100000:0.0:1786100457.677173:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+10:5602:x1872861941729024:12345-192.168.206.53@tcp:502: Request processed in 247us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100457.677181:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 124 00000100:00100000:1.0:1786100457.685886:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100457.685955:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941729152 00000100:00100000:0.0:1786100457.685964:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941729152 00000100:00100000:0.0:1786100457.686015:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 125 00000100:00100000:0.0:1786100457.686025:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:5602:x1872861941729152:12345-192.168.206.53@tcp:502: 00000100:00100000:0.0:1786100457.686236:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:5602:x1872861941729152:12345-192.168.206.53@tcp:502: Request processed in 211us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100457.686243:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 125 00000100:00100000:1.0:1786100457.689026:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100457.689686:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941729280 00000100:00100000:0.0:1786100457.689696:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941729280 00000100:00100000:0.0:1786100457.689761:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:0.0:1786100457.689769:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1872861941729280:12345-192.168.206.53@tcp:38: 00010000:00080000:0.0:1786100457.689799:0:5845:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:0.0:1786100457.689860:0:5845:0:(genops.c:1406:class_connect()) connect: client d2a93440-3d3b-4616-8388-e39125c10990, cookie 0x5564f2c20ac0d10 00000004:00100000:0.0:1786100457.689889:0:5845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1786100457.689895:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1786100457.714592:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9a3c45148800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786100457.714722:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2350:x1872861941729280:12345-192.168.206.53@tcp:38: Request processed in 24951us (25704us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100457.714747:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00010000:00010000:1.0:1786100458.661076:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100458.730584:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100458.730626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100458.730742:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941729536 00000100:00100000:3.0:1786100458.730751:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941729536 00000100:00100000:3.0:1786100458.730819:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941729408 00000100:00100000:3.0:1786100458.730823:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941729408 00000100:00100000:3.0:1786100458.730841:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:3.0:1786100458.730850:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+7:5578:x1872861941729536:12345-192.168.206.53@tcp:41: 00000004:00000024:3.0:1786100458.730906:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1786100458.730970:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+7:5578:x1872861941729536:12345-192.168.206.53@tcp:41: Request processed in 120us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100458.730977:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:3.0:1786100458.730998:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:3.0:1786100458.731004:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:0:x1872861941729408:12345-192.168.206.53@tcp:41: 00000004:00000024:3.0:1786100458.731015:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1786100458.731036:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:0:x1872861941729408:12345-192.168.206.53@tcp:41: Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100458.731042:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00080000:2.0:1786100458.731212:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100458.733240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100458.733293:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941729664 00000100:00100000:0.0:1786100458.733304:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941729664 00000100:00100000:0.0:1786100458.733449:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:0.0:1786100458.733460:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:5578:x1872861941729664:12345-192.168.206.53@tcp:40: 00000100:00100000:0.0:1786100458.733543:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:5578:x1872861941729664:12345-192.168.206.53@tcp:40: Request processed in 85us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100458.733551:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:3.0:1786100458.737146:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100458.737188:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100458.737225:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100458.737291:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941730048 00000100:00100000:3.0:1786100458.737298:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100458.737309:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941730048 00000100:00100000:0.0:1786100458.737381:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:0.0:1786100458.737392:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:5578:x1872861941730048:12345-192.168.206.53@tcp:33: 00000100:00100000:1.0:1786100458.738362:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941729792 00000100:00100000:1.0:1786100458.738373:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941729792 00000100:00100000:1.0:1786100458.738411:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941729920 00000100:00100000:1.0:1786100458.738415:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941729920 00000100:00100000:1.0:1786100458.738431:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:1.0:1786100458.738451:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1872861941729792:12345-192.168.206.53@tcp:8: 00010000:00080000:1.0:1786100458.738486:0:6683:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1786100458.738523:0:6683:0:(genops.c:1406:class_connect()) connect: client d2a93440-3d3b-4616-8388-e39125c10990, cookie 0x5564f2c20ac0d17 00002000:00100000:1.0:1786100458.738538:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d2a93440-3d3b-4616-8388-e39125c10990/ffff9a3c4514e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1786100458.738550:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1786100458.739574:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941730176 00000100:00100000:2.0:1786100458.739586:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941730176 00002000:00080000:1.0:1786100458.739626:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1786100458.739784:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 126 00000100:00100000:2.0:1786100458.739795:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+10:2353:x1872861941730176:12345-192.168.206.53@tcp:400: 00000100:00100000:2.0:1786100458.739867:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+10:2353:x1872861941730176:12345-192.168.206.53@tcp:400: Request processed in 74us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100458.739874:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 126 00000100:00080000:1.0:1786100458.740053:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9a3c4514b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786100458.740138:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:2350:x1872861941729792:12345-192.168.206.53@tcp:8: Request processed in 1686us (2911us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100458.740149:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:1.0:1786100458.740177:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:1.0:1786100458.740184:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1872861941729920:12345-192.168.206.53@tcp:8: 00010000:00080000:1.0:1786100458.740343:0:6683:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1786100458.740373:0:6683:0:(genops.c:1406:class_connect()) connect: client d2a93440-3d3b-4616-8388-e39125c10990, cookie 0x5564f2c20ac0d1e 00002000:00100000:1.0:1786100458.740385:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d2a93440-3d3b-4616-8388-e39125c10990/ffff9a3c45148000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1786100458.740396:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1786100458.741573:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1786100458.741622:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9a3c45149000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786100458.742760:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:2350:x1872861941729920:12345-192.168.206.53@tcp:8: Request processed in 2565us (5456us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100458.742775:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000004:00080000:3.0:1786100458.769836:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32364us 00000004:00200000:3.0:1786100458.793803:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1786100458.794062:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:5578:x1872861941730048:12345-192.168.206.53@tcp:33: Request processed in 56666us (56867us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100458.794087:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:2.0:1786100459.026916:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100459.027022:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941730304 00000100:00100000:1.0:1786100459.027031:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941730304 00000100:00100000:1.0:1786100459.027092:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:1.0:1786100459.027103:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:5619:x1872861941730304:12345-192.168.206.53@tcp:101: 00010000:00010000:1.0:1786100459.027135:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100459.027187:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387400/0x5564f2c20ac0d25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2e01 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100459.027247:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0d2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100459.027259:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0d2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100459.027273:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0d2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100459.027457:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1786100459.027462:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100459.027540:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0d2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100459.027568:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387400/0x5564f2c20ac0d25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e01 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100459.027585:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0d2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e01 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100459.027594:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c461b1a00) 00010000:00010000:1.0:1786100459.027597:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100459.027600:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386400, rc 0) 00000100:00100000:1.0:1786100459.028171:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+7:5619:x1872861941730304:12345-192.168.206.53@tcp:101: Request processed in 616us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100459.028180:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00010000:00010000:3.0:1786100459.684883:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100460.709100:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786100461.036302:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d2a93440-3d3b-4616-8388-e39125c10990 00000100:00100000:2.0:1786100461.300431:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100461.300521:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941730432 00000100:00100000:0.0:1786100461.300530:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941730432 00000100:00100000:0.0:1786100461.300599:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:0.0:1786100461.300609:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:5671:x1872861941730432:12345-192.168.206.53@tcp:41: 00000004:00000024:0.0:1786100461.300688:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1786100461.300764:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:5671:x1872861941730432:12345-192.168.206.53@tcp:41: Request processed in 156us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100461.300771:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00080000:2.0:1786100461.301845:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100461.313141:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100461.313226:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941730560 00000100:00100000:3.0:1786100461.313235:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941730560 00000100:00100000:3.0:1786100461.313413:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:3.0:1786100461.313423:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d2a93440-3d3b-4616-8388-e39125c10990+5:5671:x1872861941730560:12345-192.168.206.53@tcp:13: 00002000:00000024:3.0:1786100461.313473:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100461.313542:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d2a93440-3d3b-4616-8388-e39125c10990+5:5671:x1872861941730560:12345-192.168.206.53@tcp:13: Request processed in 120us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100461.313549:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00080000:2.0:1786100461.314994:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786100461.317327:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100461.317505:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941730688 00000100:00100000:3.0:1786100461.317517:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941730688 00000100:00100000:3.0:1786100461.317602:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:3.0:1786100461.317617:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d2a93440-3d3b-4616-8388-e39125c10990+6:5671:x1872861941730688:12345-192.168.206.53@tcp:13: 00000100:00080000:2.0:1786100461.317745:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1786100461.317748:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100461.317839:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d2a93440-3d3b-4616-8388-e39125c10990+6:5671:x1872861941730688:12345-192.168.206.53@tcp:13: Request processed in 226us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100461.317848:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00010000:00010000:3.0:1786100461.733730:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100461.988917:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960625664:0@lo:400: 00000100:00100000:2.0:1786100461.988988:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100461.989038:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960626176:0@lo:400: 00000100:00100000:2.0:1786100461.989064:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100461.989095:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786100461.989101:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960625792:0@lo:400: 00000100:00100000:2.0:1786100461.989122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100461.989154:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960626176 00000100:00100000:2.0:1786100461.989160:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960626176 00000100:00100000:2.0:1786100461.989213:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786100461.989222:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960626176:12345-0@lo:400: 00000100:00100000:2.0:1786100461.989286:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960626176:12345-0@lo:400: Request processed in 64us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100461.989308:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1786100461.989330:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1786100461.989360:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c74f0ce00 x1872861960626176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100461.989373:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960626176:0@lo:400: 00000100:00100000:2.0:1786100461.989398:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960625664 00000100:00100000:2.0:1786100461.989402:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960625664 00000100:00100000:2.0:1786100461.989424:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960625792 00000100:00100000:2.0:1786100461.989426:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960625792 00000100:00100000:2.0:1786100461.989448:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786100461.989454:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960625664:12345-0@lo:400: 00000100:00100000:2.0:1786100461.989489:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960625664:12345-0@lo:400: Request processed in 35us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100461.989494:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786100461.989506:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786100461.989513:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960625792:12345-0@lo:400: 00000100:00100000:2.0:1786100461.989539:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960625792:12345-0@lo:400: Request processed in 28us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100461.989545:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1786100461.989556:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100461.989573:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960625792:0@lo:400: 00000100:00100000:2.0:1786100461.989582:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960625664:0@lo:400: 00000100:00100000:3.0:1786100461.989645:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960625920:0@lo:400: 00000100:00100000:3.0:1786100461.989721:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100461.989748:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786100461.989755:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960625536:0@lo:400: 00000100:00100000:3.0:1786100461.989784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100461.989807:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960626048:0@lo:400: 00000100:00100000:3.0:1786100461.989827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100461.989854:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960626048 00000100:00100000:3.0:1786100461.989857:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960626048 00000100:00100000:3.0:1786100461.989884:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786100461.989891:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1872861960626048:12345-0@lo:400: 00000100:00100000:3.0:1786100461.989924:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1872861960626048:12345-0@lo:400: Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100461.989941:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786100461.989961:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960625536 00000100:00100000:3.0:1786100461.989965:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960625536 00000100:00100000:3.0:1786100461.989989:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1786100461.989995:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3305:x1872861960625536:12345-0@lo:400: 00000100:00100000:3.0:1786100461.990023:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3305:x1872861960625536:12345-0@lo:400: Request processed in 29us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100461.990029:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1786100461.990051:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100461.990065:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960625536:0@lo:400: 00000100:00100000:3.0:1786100461.990075:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960626048:0@lo:400: 00000100:00100000:2.0:1786100461.990665:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960625920 00000100:00100000:2.0:1786100461.990672:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960625920 00000100:00100000:2.0:1786100461.990738:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786100461.990747:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960625920:12345-0@lo:400: 00000100:00100000:2.0:1786100461.990804:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960625920:12345-0@lo:400: Request processed in 59us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100461.990811:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1786100461.990983:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c74f0e300 x1872861960625920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100461.990998:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960625920:0@lo:400: 00000100:00080000:1.0:1786100461.991064:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786100462.501149:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960626304:0@lo:13: 00000100:00100000:3.0:1786100462.502068:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100462.502285:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960626304 00000100:00100000:1.0:1786100462.502294:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960626304 00000100:00100000:1.0:1786100462.502344:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786100462.502354:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960626304:12345-0@lo:13: 00002000:00000024:1.0:1786100462.502376:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100462.502448:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960626304:12345-0@lo:13: Request processed in 95us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100462.502456:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786100462.502479:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786100462.502491:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960626432:0@lo:13: 00000100:00100000:1.0:1786100462.502522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100462.502677:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960626432 00000100:00100000:2.0:1786100462.502683:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960626432 00000100:00100000:2.0:1786100462.502719:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786100462.502726:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960626432:12345-0@lo:13: 00002000:00000024:2.0:1786100462.502742:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100462.502780:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960626432:12345-0@lo:13: Request processed in 54us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100462.502787:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1786100462.502883:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d0a80 x1872861960626304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1786100462.502886:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d0e00 x1872861960626432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100462.502920:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960626432:0@lo:13: 00000100:00100000:3.0:1786100462.502922:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960626304:0@lo:13: 00010000:00010000:1.0:1786100462.762350:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786100463.121304:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2a93440-3d3b-4616-8388-e39125c10990 00000001:00100000:1.0:1786100463.133113:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d2a93440-3d3b-4616-8388-e39125c10990 00000100:00100000:3.0:1786100463.752089:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100463.752135:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100463.752164:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100463.752212:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941731072 00000100:00100000:3.0:1786100463.752228:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941731072 00000100:00100000:3.0:1786100463.752285:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:3.0:1786100463.752296:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941731072:12345-192.168.206.53@tcp:400: 00000100:00100000:3.0:1786100463.752363:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941731072:12345-192.168.206.53@tcp:400: Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100463.752370:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:3.0:1786100463.752392:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941730944 00000100:00100000:3.0:1786100463.752396:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941730944 00000100:00100000:3.0:1786100463.752423:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:3.0:1786100463.752429:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941730944:12345-192.168.206.53@tcp:400: 00000100:00100000:3.0:1786100463.752563:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941730944:12345-192.168.206.53@tcp:400: Request processed in 131us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100463.752569:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00080000:3.0:1786100463.752586:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786100463.752591:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786100463.752619:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100463.752746:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941731200 00000100:00100000:3.0:1786100463.752750:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941731200 00000100:00100000:3.0:1786100463.752779:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:3.0:1786100463.752786:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941731200:12345-192.168.206.53@tcp:400: 00000100:00100000:3.0:1786100463.752817:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941731200:12345-192.168.206.53@tcp:400: Request processed in 32us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100463.752823:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00080000:3.0:1786100463.752837:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786100463.754037:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941730816 00000100:00100000:0.0:1786100463.754047:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941730816 00000100:00100000:0.0:1786100463.754116:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 128 00000100:00100000:0.0:1786100463.754125:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:2354:x1872861941730816:12345-192.168.206.53@tcp:400: 00000100:00100000:0.0:1786100463.754198:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:2354:x1872861941730816:12345-192.168.206.53@tcp:400: Request processed in 74us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100463.754207:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 128 00010000:00010000:3.0:1786100463.782937:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786100464.257565:0:8301:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1786100464.804941:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100465.829278:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100466.852867:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100467.115272:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786100467.115750:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960626688:0@lo:400: 00000100:00100000:0.0:1786100467.115858:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100467.115918:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786100467.115925:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960626816:0@lo:400: 00000100:00100000:0.0:1786100467.115947:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100467.115999:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960626688 00000100:00100000:0.0:1786100467.116005:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960626688 00000100:00100000:0.0:1786100467.116045:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960626816 00000100:00100000:0.0:1786100467.116047:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960626816 00000100:00100000:0.0:1786100467.116072:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786100467.116081:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960626688:12345-0@lo:400: 00000100:00100000:0.0:1786100467.116128:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960626688:12345-0@lo:400: Request processed in 48us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100467.116135:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786100467.116151:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786100467.116157:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960626816:12345-0@lo:400: 00000100:00100000:0.0:1786100467.116182:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960626816:12345-0@lo:400: Request processed in 26us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100467.116188:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786100467.116220:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960626816:0@lo:400: 00000100:00100000:0.0:1786100467.116231:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960626688:0@lo:400: 00000100:00080000:0.0:1786100467.116263:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100467.119616:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960626944:0@lo:400: 00000100:00100000:3.0:1786100467.119779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100467.119828:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960626560:0@lo:400: 00000100:00100000:3.0:1786100467.119852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100467.119969:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960626944 00000100:00100000:0.0:1786100467.119976:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960626944 00000100:00100000:0.0:1786100467.120028:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786100467.120037:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960626944:12345-0@lo:400: 00000100:00100000:0.0:1786100467.120082:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960626944:12345-0@lo:400: Request processed in 46us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100467.120088:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1786100467.120145:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786100467.120169:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d0a80 x1872861960626944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100467.120181:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960626944:0@lo:400: 00000100:00100000:0.0:1786100467.120550:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1872861960627072:0@lo:400: 00000100:00100000:0.0:1786100467.120578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100467.120606:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960627072 00000100:00100000:0.0:1786100467.120609:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960627072 00000100:00100000:0.0:1786100467.120638:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786100467.120645:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1872861960627072:12345-0@lo:400: 00000100:00100000:0.0:1786100467.120704:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1872861960627072:12345-0@lo:400: Request processed in 60us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100467.120710:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786100467.120738:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1872861960627072:0@lo:400: 00000100:00080000:3.0:1786100467.120837:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100467.120862:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960627200:0@lo:400: 00000100:00100000:3.0:1786100467.120886:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100467.120953:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960627200 00000100:00100000:0.0:1786100467.120956:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960627200 00000100:00100000:0.0:1786100467.120989:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786100467.120995:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960627200:12345-0@lo:400: 00000100:00100000:0.0:1786100467.121024:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960627200:12345-0@lo:400: Request processed in 30us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100467.121030:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1786100467.121076:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1786100467.121095:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d0a80 x1872861960627200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100467.121105:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960627200:0@lo:400: 00000100:00100000:1.0:1786100467.121213:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960626560 00000100:00100000:1.0:1786100467.121217:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960626560 00000100:00100000:1.0:1786100467.121249:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1786100467.121256:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3305:x1872861960626560:12345-0@lo:400: 00000100:00100000:1.0:1786100467.121371:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3305:x1872861960626560:12345-0@lo:400: Request processed in 115us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100467.121389:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1786100467.126967:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960626560:0@lo:400: 00000100:00100000:3.0:1786100467.620854:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786100467.620880:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960627328:0@lo:13: 00000100:00100000:3.0:1786100467.620941:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100467.620997:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960627328 00000100:00100000:3.0:1786100467.621002:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960627328 00000100:00100000:3.0:1786100467.621040:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786100467.621048:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960627328:12345-0@lo:13: 00002000:00000024:3.0:1786100467.621078:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100467.621165:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960627328:12345-0@lo:13: Request processed in 117us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100467.621179:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1786100467.621228:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c50d88000 x1872861960627328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100467.621244:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960627328:0@lo:13: 00000100:00100000:3.0:1786100467.632630:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960627456:0@lo:13: 00000100:00100000:3.0:1786100467.632729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100467.632788:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960627456 00000100:00100000:3.0:1786100467.632795:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960627456 00000100:00100000:3.0:1786100467.632835:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786100467.632843:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960627456:12345-0@lo:13: 00002000:00000024:3.0:1786100467.632876:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100467.632915:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960627456:12345-0@lo:13: Request processed in 72us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100467.632921:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1786100467.632958:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c50d88000 x1872861960627456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100467.632978:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960627456:0@lo:13: 00010000:00010000:3.0:1786100467.877893:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786100468.096370:0:8448:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb74494b0 20000000:00000080:3.0:1786100468.096386:0:8448:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a3c7f440000 uarg=0000000000000000 20000000:01000000:3.0:1786100468.096421:0:8448:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1786100468.096424:0:8448:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1786100468.096427:0:8448:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1786100468.096432:0:8448:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1786100468.096435:0:8448:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1786100468.096448:0:8448:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1786100468.097182:0:8448:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1786100468.097367:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1786100468.097370:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1786100468.099740:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1786100468.100408:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1786100468.100744:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1786100468.100786:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1786100468.100799:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1786100468.100801:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1786100468.103196:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1786100468.105076:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1786100468.105151:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1786100468.105221:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1786100468.105251:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1786100468.105255:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1786100468.108209:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1786100468.109311:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1786100468.109373:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1786100468.109492:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1786100468.112714:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1786100468.112909:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1786100468.128801:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1786100468.138331:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1786100468.138450:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1786100468.138514:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:1.0:1786100468.138535:0:8448:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786100468.138553:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138569:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0c29 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138577:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa0b800/0x5564f2c20ac0c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0c53 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138583:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4fbba600/0x5564f2c20ac0c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0c7d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138589:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0c8b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138607:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa0bc00/0x5564f2c20ac0ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0c99 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138614:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0cbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0cb5 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138620:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa0a800/0x5564f2c20ac0ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0cdf expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138629:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac0cf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2d9f expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138636:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa0a000/0x5564f2c20ac0cfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2da6 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138643:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138713:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa0a000/0x5564f2c20ac0cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2da6 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138730:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c7fa0a000/0x5564f2c20ac0cfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2da6 expref: 9 pid: 5835 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100468.138745:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960627584:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100468.138868:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac0cf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2d9f expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138877:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac0cf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2d9f expref: 9 pid: 5838 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100468.138896:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960627712:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100468.138946:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa0a800/0x5564f2c20ac0ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0cdf expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.138955:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c7fa0a800/0x5564f2c20ac0ce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0cdf expref: 18 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100468.138965:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960627840:0@lo:104: 00000100:00100000:1.0:1786100468.139012:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786100468.139056:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0cb5 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.139065:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0cbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0cb5 expref: 18 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100468.139074:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960627968:0@lo:104: 00000100:00100000:1.0:1786100468.139111:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786100468.139150:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa0bc00/0x5564f2c20ac0ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0c99 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.139157:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c7fa0bc00/0x5564f2c20ac0ca0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0c99 expref: 18 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100468.139166:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960628096:0@lo:104: 00010000:00010000:1.0:1786100468.139192:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0c8b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.139200:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0c92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0c8b expref: 18 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100468.139204:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1786100468.139221:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960628224:0@lo:104: 00000100:00100000:2.0:1786100468.139229:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100468.139245:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960627840 00000100:00100000:2.0:1786100468.139251:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960627840 00000100:00100000:1.0:1786100468.139256:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786100468.139281:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4fbba600/0x5564f2c20ac0c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0c7d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100468.139286:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960627968 00000100:00100000:2.0:1786100468.139290:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960627968 00010000:00010000:1.0:1786100468.139291:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c4fbba600/0x5564f2c20ac0c84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0c7d expref: 18 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100468.139302:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960628352:0@lo:104: 00000100:00100000:2.0:1786100468.139303:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960628096 00000100:00100000:2.0:1786100468.139307:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960628096 00000100:00100000:2.0:1786100468.139320:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960628224 00000100:00100000:2.0:1786100468.139323:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960628224 00000100:00100000:1.0:1786100468.139334:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100468.139338:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786100468.139348:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+6:8448:x1872861960627840:12345-0@lo:104: 00010000:00010000:1.0:1786100468.139357:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa0b800/0x5564f2c20ac0c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0c53 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.139361:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0ce6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.139366:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c7fa0b800/0x5564f2c20ac0c5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0c53 expref: 18 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100468.139388:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960628480:0@lo:104: 00000100:00100000:1.0:1786100468.139413:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786100468.139433:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0c29 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100468.139441:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0c30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0c29 expref: 18 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100468.139449:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960628608:0@lo:104: 00000100:00100000:1.0:1786100468.139468:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100468.139477:0:8448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c450ad480 going to sleep for 11 seconds 00000100:00100000:0.0:1786100468.141353:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1786100468.141456:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1786100468.144085:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960628352 00000100:00100000:0.0:1786100468.144103:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960628352 00000100:00100000:0.0:1786100468.144174:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1786100468.144185:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960628480 00000100:00100000:0.0:1786100468.144188:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960628480 00000100:00100000:0.0:1786100468.144200:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1786100468.144205:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960628608 00000100:00100000:0.0:1786100468.144208:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960628608 00000100:00100000:0.0:1786100468.144302:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786100468.144315:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+9:8448:x1872861960627968:12345-0@lo:104: 00010000:00010000:0.0:1786100468.144338:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0cbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.144738:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786100468.144747:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+9:8448:x1872861960627968:12345-0@lo:104: Request processed in 433us (5637us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100468.144755:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1786100468.144781:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100468.144801:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0cbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.144810:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0b200 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100468.144815:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0cbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.144823:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0cbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100468.144830:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0cbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100468.144857:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786100468.144902:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0cbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.144908:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100468.144932:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0cbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.144939:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b200/0x5564f2c20ac0cb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0cbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.144953:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100468.144955:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100468.144956:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100468.144982:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960628736:0@lo:103: 00000100:00100000:0.0:1786100468.145031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100468.145091:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960628736 00000100:00100000:0.0:1786100468.145095:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960628736 00010000:00010000:0.0:1786100468.145123:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0cbc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0cb5 expref: 19 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100468.145169:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1786100468.145180:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3306:x1872861960628736:12345-0@lo:103: 00010000:00010000:0.0:1786100468.145193:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100468.145200:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0cbc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0cb5 expref: 19 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.145212:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0cbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0cb5 expref: 19 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.145244:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100468.145278:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3306:x1872861960628736:12345-0@lo:103: Request processed in 102us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100468.145285:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1786100468.145366:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960628736:0@lo:103: 00000100:00100000:0.0:1786100468.145411:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786100468.145423:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+8:8448:x1872861960628096:12345-0@lo:104: 00010000:00010000:0.0:1786100468.145433:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0ca0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.147465:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786100468.147485:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+8:8448:x1872861960628096:12345-0@lo:104: Request processed in 2060us (8251us total) trans 0 rc 0/0 00010000:00010000:1.0:1786100468.147691:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0cbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0cb5 expref: 18 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100468.147723:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960627968:0@lo:104: 00000100:00100000:1.0:1786100468.147739:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960628096:0@lo:104: 00010000:00010000:2.0:1786100468.148038:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786100468.148049:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+8:8448:x1872861960627840:12345-0@lo:104: Request processed in 8702us (9036us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100468.148062:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786100468.148114:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786100468.148136:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+7:8448:x1872861960628224:12345-0@lo:104: 00010000:00010000:2.0:1786100468.148150:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0c92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.148197:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1786100468.148203:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+7:8448:x1872861960628224:12345-0@lo:104: Request processed in 82us (8949us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100468.148209:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786100468.148224:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786100468.148230:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+6:8448:x1872861960628352:12345-0@lo:104: 00010000:00010000:2.0:1786100468.148238:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0c84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.148267:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1786100468.148272:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+6:8448:x1872861960628352:12345-0@lo:104: Request processed in 43us (8939us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100468.148277:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786100468.148291:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786100468.148298:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:8448:x1872861960628480:12345-0@lo:104: 00010000:00010000:2.0:1786100468.148305:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0c5a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.148341:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1786100468.148346:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:8448:x1872861960628480:12345-0@lo:104: Request processed in 50us (8933us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100468.148352:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786100468.148365:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786100468.148372:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:8448:x1872861960628608:12345-0@lo:104: 00010000:00010000:2.0:1786100468.148379:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0c30 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.148404:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1786100468.148408:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:8448:x1872861960628608:12345-0@lo:104: Request processed in 38us (8940us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100468.148415:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786100468.148637:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960627840:0@lo:104: 00000100:00100000:3.0:1786100468.148647:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960628224:0@lo:104: 00000100:00100000:3.0:1786100468.148698:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960628352:0@lo:104: 00000100:00100000:3.0:1786100468.148706:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960628480:0@lo:104: 00000100:00100000:3.0:1786100468.148712:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960628608:0@lo:104: 00010000:00010000:2.0:1786100468.149235:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1786100468.149243:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0ca0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149252:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386a00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:2.0:1786100468.149256:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0ca0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149265:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0ca0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786100468.149272:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0ca0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100468.149278:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786100468.149327:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ca0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149334:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786100468.149354:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ca0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149366:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0c99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ca0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149377:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1786100468.149380:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0ce6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149386:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0aa00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:2.0:1786100468.149389:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0ce6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149395:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0ce6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786100468.149401:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0ce6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100468.149405:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786100468.149418:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ce6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149423:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786100468.149428:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ce6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149444:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0aa00/0x5564f2c20ac0cdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ce6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149453:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1786100468.149456:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0c92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149462:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0b000 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:2.0:1786100468.149465:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0c92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149471:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0c92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786100468.149478:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0c92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100468.149483:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786100468.149497:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149502:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786100468.149516:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149522:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b000/0x5564f2c20ac0c8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149531:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786100468.149541:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0c84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149547:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0b600 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:2.0:1786100468.149550:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0c84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149557:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0c84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786100468.149563:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0c84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100468.149568:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786100468.149583:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149590:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786100468.149598:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149604:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0c7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149637:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1786100468.149642:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1786100468.149645:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0c5a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149691:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386800 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:2.0:1786100468.149694:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0c5a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149713:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0c5a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.149717:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1786100468.149722:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0c5a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100468.149730:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786100468.149748:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c5a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149754:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786100468.149759:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c5a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100468.149766:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960628992:0@lo:103: 00010000:00010000:2.0:1786100468.149770:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c62386800/0x5564f2c20ac0c53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c5a expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100468.149786:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100468.149788:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100468.149791:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100468.149810:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960628864:0@lo:103: 00000100:00100000:0.0:1786100468.149850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100468.149924:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960629120:0@lo:103: 00000100:00100000:2.0:1786100468.151526:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100468.151583:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960629376:0@lo:103: 00000100:00100000:2.0:1786100468.151621:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100468.151694:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100468.151718:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100468.151966:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100468.152041:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786100468.152056:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960629248:0@lo:103: 00000100:00100000:0.0:1786100468.152100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100468.152344:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960628992 00000100:00100000:0.0:1786100468.152355:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960628992 00010000:00010000:0.0:1786100468.152424:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa0a800/0x5564f2c20ac0ce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0cdf expref: 18 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100468.152770:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960628864 00000100:00100000:0.0:1786100468.152775:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960628864 00010000:00010000:0.0:1786100468.152794:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa0bc00/0x5564f2c20ac0ca0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0c99 expref: 19 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100468.152806:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960629376 00000100:00100000:0.0:1786100468.152809:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960629376 00010000:00010000:0.0:1786100468.152822:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa0b800/0x5564f2c20ac0c5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0c53 expref: 20 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100468.152832:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941731328 00000100:00100000:0.0:1786100468.152835:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941731328 00010000:00010000:0.0:1786100468.152848:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa0a000/0x5564f2c20ac0cfb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2da6 expref: 10 pid: 5835 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100468.152858:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941731456 00000100:00100000:0.0:1786100468.152860:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941731456 00010000:00010000:0.0:1786100468.152871:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac0cf4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2d9f expref: 11 pid: 5838 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100468.152880:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960629120 00000100:00100000:0.0:1786100468.152882:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960629120 00010000:00010000:0.0:1786100468.152891:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0c92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0c8b expref: 21 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100468.152900:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960629248 00000100:00100000:0.0:1786100468.152903:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960629248 00010000:00010000:0.0:1786100468.152912:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4fbba600/0x5564f2c20ac0c84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0c7d expref: 22 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100468.152926:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786100468.152945:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+22:3308:x1872861960628992:12345-0@lo:103: 00010000:00010000:0.0:1786100468.152963:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100468.152969:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa0a800/0x5564f2c20ac0ce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0cdf expref: 22 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.152980:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa0a800/0x5564f2c20ac0ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0cdf expref: 22 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.153002:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0a800/0x5564f2c20ac0ce6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0cdf expref: 22 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.153020:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100468.153087:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+21:3308:x1872861960628992:12345-0@lo:103: Request processed in 144us (3237us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100468.153094:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786100468.153114:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786100468.153121:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+20:3307:x1872861960628864:12345-0@lo:103: 00010000:00010000:0.0:1786100468.153129:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100468.153194:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa0bc00/0x5564f2c20ac0ca0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0c99 expref: 20 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.153202:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa0bc00/0x5564f2c20ac0ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0c99 expref: 20 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.153212:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0bc00/0x5564f2c20ac0ca0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0c99 expref: 20 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.153221:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100468.153256:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960628864:12345-0@lo:103: Request processed in 135us (3137us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100468.153271:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786100468.153285:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786100468.153291:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:3307:x1872861960629376:12345-0@lo:103: 00010000:00010000:0.0:1786100468.153300:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100468.153305:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa0b800/0x5564f2c20ac0c5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0c53 expref: 18 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.153313:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa0b800/0x5564f2c20ac0c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0c53 expref: 18 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.153324:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0b800/0x5564f2c20ac0c5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0c53 expref: 18 pid: 5838 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.153332:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100468.153357:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:3307:x1872861960629376:12345-0@lo:103: Request processed in 66us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100468.153363:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786100468.154186:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:0.0:1786100468.154204:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d69173c-d092-48de-a520-1459f9171aec+11:2352:x1872861941731328:12345-192.168.206.53@tcp:103: 00010000:00010000:0.0:1786100468.154221:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100468.154227:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa0a000/0x5564f2c20ac0cfb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2da6 expref: 11 pid: 5835 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.154241:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa0a000/0x5564f2c20ac0cfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2da6 expref: 11 pid: 5835 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.154257:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100468.154316:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d69173c-d092-48de-a520-1459f9171aec+11:2352:x1872861941731328:12345-192.168.206.53@tcp:103: Request processed in 121us (2623us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100468.154340:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:0.0:1786100468.154357:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:0.0:1786100468.154366:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d69173c-d092-48de-a520-1459f9171aec+10:2352:x1872861941731456:12345-192.168.206.53@tcp:103: 00010000:00010000:0.0:1786100468.154382:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100468.154386:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac0cf4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2d9f expref: 10 pid: 5838 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.154397:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac0cf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2d9f expref: 10 pid: 5838 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.154407:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100468.154426:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d69173c-d092-48de-a520-1459f9171aec+10:2352:x1872861941731456:12345-192.168.206.53@tcp:103: Request processed in 60us (2707us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100468.154433:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:0.0:1786100468.154460:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786100468.154467:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d74850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:3305:x1872861960629120:12345-0@lo:103: 00010000:00010000:0.0:1786100468.154474:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100468.154480:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0c92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0c8b expref: 16 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.154495:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0c8b expref: 16 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.154506:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0c92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0c8b expref: 16 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.154519:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100468.154569:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d74850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:3305:x1872861960629120:12345-0@lo:103: Request processed in 102us (2610us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100468.154576:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786100468.154618:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786100468.154631:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:3305:x1872861960629248:12345-0@lo:103: 00010000:00010000:0.0:1786100468.154637:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100468.154644:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4fbba600/0x5564f2c20ac0c84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0c7d expref: 14 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.154678:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4fbba600/0x5564f2c20ac0c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0c7d expref: 14 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.154687:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbba600/0x5564f2c20ac0c84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0c7d expref: 14 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.154696:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100468.154717:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:3305:x1872861960629248:12345-0@lo:103: Request processed in 88us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100468.154724:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786100468.154848:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960628992:0@lo:103: 00000100:00100000:0.0:1786100468.154938:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960628864:0@lo:103: 00000100:00100000:0.0:1786100468.154949:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960629376:0@lo:103: 00000100:00100000:0.0:1786100468.155197:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960629248:0@lo:103: 00000100:00100000:0.0:1786100468.156689:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960629120:0@lo:103: 00010000:00010000:0.0:1786100468.156808:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100468.156823:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0c30 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.157214:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb000 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100468.157220:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0c30 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.157231:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0c30 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100468.157238:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0c30 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100468.157243:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786100468.157501:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0a000/0x5564f2c20ac0cfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2da6 expref: 9 pid: 5835 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100468.157522:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960627584:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100468.157536:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac0cf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2d9f expref: 8 pid: 5838 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100468.157545:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1872861960627712:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100468.157557:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c30 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.157567:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786100468.157589:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.157611:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c30 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.157621:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0c29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c30 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.157643:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100468.157645:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100468.157647:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100468.157897:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960629504:0@lo:103: 00000100:00100000:3.0:1786100468.157955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100468.159542:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960629504 00000100:00100000:0.0:1786100468.159559:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960629504 00010000:00010000:0.0:1786100468.159612:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0c30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0c29 expref: 13 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100468.159689:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786100468.159717:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:3308:x1872861960629504:12345-0@lo:103: 00010000:00010000:0.0:1786100468.159735:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100468.159743:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0c30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0c29 expref: 13 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.159756:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0c29 expref: 13 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.159777:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0c30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0c29 expref: 13 pid: 5837 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.159798:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.159806:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.159824:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.159831:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.159838:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.159845:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.159851:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387c00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100468.159856:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.159873:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.159896:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100468.159909:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100468.160001:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:3308:x1872861960629504:12345-0@lo:103: Request processed in 287us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100468.160009:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786100468.160062:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960629504:0@lo:103: 00010000:00010000:0.0:1786100468.160089:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100468.160093:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100468.160347:0:8448:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100468.160364:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100468.160372:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62387c00/0x5564f2c20ac0d33 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100468.872109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100468.874058:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100468.874133:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100468.874303:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941731712 00000100:00100000:3.0:1786100468.874312:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941731712 00000100:00100000:0.0:1786100468.874317:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941731840 00000100:00100000:0.0:1786100468.874323:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941731840 00000100:00100000:3.0:1786100468.874406:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:3.0:1786100468.874424:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+5:2353:x1872861941731712:12345-192.168.206.53@tcp:400: 00000100:00100000:3.0:1786100468.874483:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+5:2353:x1872861941731712:12345-192.168.206.53@tcp:400: Request processed in 60us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100468.874499:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:1.0:1786100468.875140:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941731584 00000100:00100000:1.0:1786100468.875145:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941731584 00000100:00080000:2.0:1786100468.879271:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786100468.879281:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786100468.879284:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786100468.879517:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:1.0:1786100468.879533:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941731584:12345-192.168.206.53@tcp:400: 00000100:00100000:1.0:1786100468.879609:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941731584:12345-192.168.206.53@tcp:400: Request processed in 82us (7509us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100468.879617:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:0.0:1786100468.879696:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:0.0:1786100468.879706:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941731840:12345-192.168.206.53@tcp:400: 00000100:00100000:0.0:1786100468.879733:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941731840:12345-192.168.206.53@tcp:400: Request processed in 30us (5600us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100468.879739:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00010000:00010000:2.0:1786100468.900889:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1786100469.220791:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786100469.220798:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a3c7f9ee000 from 39 10000000:01000000:2.0:1786100469.220803:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786100469.220848:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.220859:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.220871:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100469.220895:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960629632:0@lo:101: 00000100:00100000:2.0:1786100469.221028:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100469.221146:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c480e8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786100469.225622:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960629632 00000100:00100000:3.0:1786100469.225637:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960629632 00000100:00100000:3.0:1786100469.225735:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1786100469.225746:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+12:5840:x1872861960629632:12345-0@lo:101: 00010000:00010000:3.0:1786100469.225762:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100469.225781:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c41511a00/0x5564f2c20ac0d41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0d3a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.225807:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c41511a00/0x5564f2c20ac0d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0d3a expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.225818:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c41511a00/0x5564f2c20ac0d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0d3a expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.225826:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c41511a00, rc 0) 00000100:00100000:3.0:1786100469.226686:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:5840:x1872861960629632:12345-0@lo:101: Request processed in 906us (5622us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100469.226695:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1786100469.230638:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960629632:0@lo:101: 00010000:00010000:2.0:1786100469.230691:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.230703:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100469.230781:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960629760:0@lo:501: 00000100:00100000:2.0:1786100469.230838:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100469.233720:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c480e8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786100469.237172:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960629760 00000100:00100000:1.0:1786100469.237187:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960629760 00000100:00100000:1.0:1786100469.237303:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1786100469.237315:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:5840:x1872861960629760:12345-0@lo:501: 00000100:00100000:1.0:1786100469.238363:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:5840:x1872861960629760:12345-0@lo:501: Request processed in 1048us (7522us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100469.238380:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1786100469.238573:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960629760:0@lo:501: 00000100:00100000:2.0:1786100469.238618:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960629888:0@lo:503: 00000100:00100000:2.0:1786100469.238921:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100469.241510:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c480e8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786100469.243938:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960629888 00000100:00100000:1.0:1786100469.243950:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960629888 00000100:00100000:0.0:1786100469.245951:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1786100469.245971:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:5840:x1872861960629888:12345-0@lo:503: 00000100:00100000:0.0:1786100469.246679:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:5840:x1872861960629888:12345-0@lo:503: Request processed in 683us (7724us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100469.246688:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1786100469.246803:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960629888:0@lo:503: 00000100:00100000:2.0:1786100469.247038:0:8466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8466:1872861960630016:0@lo:502: 00000100:00100000:2.0:1786100469.247077:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100469.252068:0:8466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c480e8480 going to sleep for 11 seconds 00000100:00100000:3.0:1786100469.256877:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960630016 00000100:00100000:3.0:1786100469.256890:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960630016 00000100:00100000:3.0:1786100469.256949:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1786100469.256958:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:8466:x1872861960630016:12345-0@lo:502: 00000100:00100000:3.0:1786100469.257361:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:8466:x1872861960630016:12345-0@lo:502: Request processed in 404us (10282us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100469.257369:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1786100469.257618:0:8466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8466:1872861960630016:0@lo:502: 00000100:00100000:2.0:1786100469.257707:0:8466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8466:1872861960630144:0@lo:502: 00000100:00100000:2.0:1786100469.257750:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100469.257775:0:8466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c480e8480 going to sleep for 11 seconds 00000100:00100000:1.0:1786100469.257840:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960630144 00000100:00100000:1.0:1786100469.257846:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960630144 00000100:00100000:1.0:1786100469.257871:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1786100469.257878:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:8466:x1872861960630144:12345-0@lo:502: 00000100:00100000:1.0:1786100469.260244:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:8466:x1872861960630144:12345-0@lo:502: Request processed in 2359us (2486us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100469.260257:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1786100469.260758:0:8466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8466:1872861960630144:0@lo:502: 00000040:00080000:2.0:1786100469.260794:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1786100469.260967:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1786100469.260985:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786100469.260996:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.261135:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100469.261144:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1786100469.261146:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1786100469.261149:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1786100469.261176:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.261183:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.261193:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100469.261210:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960630272:0@lo:101: 00000100:00100000:3.0:1786100469.261255:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100469.261292:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100469.261339:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960630272 00000100:00100000:2.0:1786100469.261345:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960630272 00000100:00100000:2.0:1786100469.261385:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1786100469.261394:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+13:5840:x1872861960630272:12345-0@lo:101: 00010000:00010000:2.0:1786100469.261405:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100469.261426:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0b000/0x5564f2c20ac0d4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0d48 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.261446:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0b000/0x5564f2c20ac0d4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0d48 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.261455:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0b000/0x5564f2c20ac0d4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0d48 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.261469:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0b000, rc 0) 00000100:00100000:2.0:1786100469.261637:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960630272:12345-0@lo:101: Request processed in 243us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100469.261643:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1786100469.261804:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960630272:0@lo:101: 00010000:00010000:3.0:1786100469.261816:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.261824:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100469.261866:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960630400:0@lo:501: 00000100:00100000:3.0:1786100469.261892:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100469.261926:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100469.261984:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960630400 00000100:00100000:2.0:1786100469.261988:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960630400 00000100:00100000:2.0:1786100469.262171:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1786100469.262180:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960630400:12345-0@lo:501: 00000100:00100000:2.0:1786100469.262427:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960630400:12345-0@lo:501: Request processed in 248us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100469.262434:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1786100469.264238:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960630400:0@lo:501: 00000100:00100000:3.0:1786100469.264285:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960630528:0@lo:503: 00000100:00100000:3.0:1786100469.264340:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100469.273700:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100469.275235:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960630528 00000100:00100000:1.0:1786100469.275248:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960630528 00000100:00100000:1.0:1786100469.275302:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1786100469.275312:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960630528:12345-0@lo:503: 00000100:00100000:1.0:1786100469.276383:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960630528:12345-0@lo:503: Request processed in 1067us (12036us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100469.276393:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1786100469.278612:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960630528:0@lo:503: 00000100:00100000:0.0:1786100469.290919:0:8467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8467:1872861960630656:0@lo:502: 00000100:00100000:0.0:1786100469.292273:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100469.292372:0:8467:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddbaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1786100469.296815:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960630656 00000100:00100000:1.0:1786100469.296829:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960630656 00000100:00100000:2.0:1786100469.299735:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1786100469.299748:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:8467:x1872861960630656:12345-0@lo:502: 00000100:00100000:2.0:1786100469.299977:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:8467:x1872861960630656:12345-0@lo:502: Request processed in 231us (7707us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100469.299984:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1786100469.300085:0:8467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8467:1872861960630656:0@lo:502: 00000020:01000000:0.0:1786100469.300115:0:8467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100469.300124:0:8467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100469.300126:0:8467:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1786100469.300133:0:8467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1786100469.300161:0:8467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8467:1872861960630784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100469.300196:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100469.311218:0:8467:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddbaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1786100469.313177:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960630784 00000100:00100000:3.0:1786100469.313191:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960630784 00000100:00100000:3.0:1786100469.313250:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1786100469.313260:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:8467:x1872861960630784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100469.313695:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:8467:x1872861960630784:12345-0@lo:502:llog_process_th.0 Request processed in 436us (13497us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100469.313704:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1786100469.313836:0:8467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8467:1872861960630784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786100469.313869:0:8467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100469.313876:0:8467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100469.313878:0:8467:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1786100469.313885:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1786100469.314549:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1786100469.314569:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1786100469.314578:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.314588:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100469.314596:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786100469.314598:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a3c6e163000 from 39 10000000:01000000:3.0:1786100469.314601:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786100469.314629:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.314637:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.315123:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100469.315325:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960630912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786100469.315368:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100469.315404:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100469.315544:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960630912 00000100:00100000:2.0:1786100469.315550:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960630912 00000100:00100000:2.0:1786100469.315590:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1786100469.315597:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:5840:x1872861960630912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786100469.315608:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100469.315618:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0aa00/0x5564f2c20ac0d5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0d56 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.315639:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0aa00/0x5564f2c20ac0d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0d56 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.315687:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0aa00/0x5564f2c20ac0d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0d56 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.315696:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0aa00, rc 0) 00000100:00100000:2.0:1786100469.315724:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960630912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100469.315730:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1786100469.315834:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960630912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100469.315845:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.315854:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100469.315895:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960631040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786100469.315916:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100469.315930:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100469.315974:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960631040 00000100:00100000:2.0:1786100469.315978:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960631040 00000100:00100000:2.0:1786100469.316002:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1786100469.316179:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960631040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100469.316958:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960631040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 948us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100469.316966:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1786100469.317317:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960631040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786100469.317352:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960631168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786100469.317390:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100469.317452:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100469.319176:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960631168 00000100:00100000:1.0:1786100469.319189:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960631168 00000100:00100000:0.0:1786100469.322589:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1786100469.322614:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960631168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100469.322902:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960631168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 300us (5511us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100469.322911:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1786100469.323166:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960631168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100469.324758:0:8468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8468:1872861960631296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100469.324830:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100469.324865:0:8468:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c480e83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100469.325157:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960631296 00000100:00100000:0.0:1786100469.325165:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960631296 00000100:00100000:0.0:1786100469.325212:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1786100469.325397:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:8468:x1872861960631296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100469.326593:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:8468:x1872861960631296:12345-0@lo:502:llog_process_th.0 Request processed in 1368us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100469.326614:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1786100469.327198:0:8468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8468:1872861960631296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100469.327732:0:8468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8468:1872861960631424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100469.327786:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100469.327879:0:8468:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c480e83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100469.332551:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960631424 00000100:00100000:3.0:1786100469.332565:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960631424 00000100:00100000:3.0:1786100469.332616:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1786100469.332625:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:8468:x1872861960631424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100469.337683:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:8468:x1872861960631424:12345-0@lo:502:llog_process_th.0 Request processed in 5023us (9862us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100469.337697:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1786100469.340552:0:8468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8468:1872861960631424:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786100469.340604:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1786100469.346536:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1786100469.346573:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786100469.346584:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.346595:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100469.346604:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1786100469.346607:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1786100469.346611:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1786100469.347523:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.347535:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.347546:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100469.347569:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960631552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786100469.347627:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100469.349552:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100469.352314:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960631552 00000100:00100000:0.0:1786100469.352329:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960631552 00000100:00100000:1.0:1786100469.355376:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1786100469.355389:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:5840:x1872861960631552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786100469.355405:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100469.355433:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c62387400/0x5564f2c20ac0d6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0d64 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100469.355459:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62387400/0x5564f2c20ac0d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0d64 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100469.355483:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c62387400/0x5564f2c20ac0d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0d64 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100469.355490:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62387400, rc 0) 00000100:00100000:1.0:1786100469.355564:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960631552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (7936us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100469.355570:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1786100469.355687:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960631552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100469.355704:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.355713:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100469.355790:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960631680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786100469.355823:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100469.360418:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960631680 00000100:00100000:0.0:1786100469.360433:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960631680 00000100:00100000:3.0:1786100469.360461:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100469.360488:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1786100469.360499:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960631680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100469.361297:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960631680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 797us (5470us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100469.361306:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1786100469.363192:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960631680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786100469.363258:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960631808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786100469.363325:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100469.363365:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100469.363558:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960631808 00000100:00100000:2.0:1786100469.363564:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960631808 00000100:00100000:2.0:1786100469.363620:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1786100469.363630:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960631808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100469.363850:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960631808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100469.363857:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1786100469.365206:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960631808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100469.365904:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8469:1872861960631936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100469.365972:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100469.366028:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c480e8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786100469.366241:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960631936 00000100:00100000:0.0:1786100469.366247:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960631936 00000100:00100000:0.0:1786100469.366295:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1786100469.366304:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:8469:x1872861960631936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100469.366678:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:8469:x1872861960631936:12345-0@lo:502:llog_process_th.0 Request processed in 345us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100469.366687:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1786100469.366822:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8469:1872861960631936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786100469.366846:0:8469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786100469.366855:0:8469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786100469.366857:0:8469:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1786100469.366863:0:8469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1786100469.366885:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8469:1872861960632064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100469.366934:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100469.366961:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100469.367129:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960632064 00000100:00100000:0.0:1786100469.367133:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960632064 00000100:00100000:0.0:1786100469.367164:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1786100469.367171:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:8469:x1872861960632064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100469.367590:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:8469:x1872861960632064:12345-0@lo:502:llog_process_th.0 Request processed in 418us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100469.367607:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1786100469.367707:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8469:1872861960632064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786100469.367728:0:8469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786100469.367733:0:8469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786100469.367734:0:8469:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1786100469.367739:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1786100469.368165:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1786100469.368184:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1786100469.368193:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100469.368203:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100469.368212:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1786100469.368214:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a3c47abb000 from 39 10000000:01000000:0.0:1786100469.368314:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786100469.368344:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100469.368352:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100469.368361:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100469.368379:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960632192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786100469.369493:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100469.370559:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960632192 00000100:00100000:1.0:1786100469.370571:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960632192 00000100:00100000:3.0:1786100469.373244:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba480 going to sleep for 11 seconds 00000100:00100000:2.0:1786100469.374173:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1786100469.374197:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960632192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786100469.374312:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100469.374333:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0d79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0d72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.374361:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0d72 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.374372:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0d72 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.374381:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0ba00, rc 0) 00000100:00100000:2.0:1786100469.374527:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960632192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 343us (5037us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100469.374535:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1786100469.374622:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960632192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100469.374639:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.374699:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100469.374767:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960632320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786100469.374798:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100469.374826:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100469.374881:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960632320 00000100:00100000:0.0:1786100469.374887:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960632320 00000100:00100000:0.0:1786100469.374918:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1786100469.374926:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960632320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100469.375168:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960632320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100469.375180:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1786100469.375923:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960632320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786100469.375965:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960632448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786100469.376029:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100469.376049:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100469.376204:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960632448 00000100:00100000:0.0:1786100469.376209:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960632448 00000100:00100000:0.0:1786100469.376247:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1786100469.376255:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960632448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100469.376539:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960632448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 283us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100469.376546:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1786100469.376621:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960632448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100469.377310:0:8470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8470:1872861960632576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100469.377359:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100469.377392:0:8470:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c480e89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100469.377496:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960632576 00000100:00100000:0.0:1786100469.377501:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960632576 00000100:00100000:0.0:1786100469.377536:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1786100469.377543:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:8470:x1872861960632576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100469.379045:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:8470:x1872861960632576:12345-0@lo:502:llog_process_th.0 Request processed in 1497us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100469.379058:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1786100469.382912:0:8470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8470:1872861960632576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100469.382997:0:8470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8470:1872861960632704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100469.383353:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100469.383434:0:8470:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100469.386854:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960632704 00000100:00100000:0.0:1786100469.386869:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960632704 00000100:00100000:0.0:1786100469.386971:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1786100469.386981:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:8470:x1872861960632704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100469.388866:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:8470:x1872861960632704:12345-0@lo:502:llog_process_th.0 Request processed in 1879us (5506us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100469.388877:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1786100469.388974:0:8470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8470:1872861960632704:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1786100469.389024:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1786100469.389186:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1786100469.389214:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786100469.389234:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.389245:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100469.389255:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1786100469.389258:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1786100469.389260:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1786100469.389292:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.389300:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.389308:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100469.389328:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960632832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786100469.389365:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100469.395690:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c480e80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100469.399737:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960632832 00000100:00100000:1.0:1786100469.399751:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960632832 00000100:00100000:2.0:1786100469.399883:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1786100469.399894:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960632832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786100469.399922:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100469.399940:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0d87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0d80 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.399982:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0d80 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.399994:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0d80 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.400003:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0ae00, rc 0) 00000100:00100000:2.0:1786100469.400096:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960632832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (10730us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100469.400103:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1786100469.400534:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960632832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786100469.400552:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100469.400561:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100469.400627:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960632960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100469.400748:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100469.400781:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c450ad180 going to sleep for 11 seconds 00000100:00100000:2.0:1786100469.400853:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960632960 00000100:00100000:2.0:1786100469.400858:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960632960 00000100:00100000:2.0:1786100469.400890:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1786100469.400898:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960632960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100469.401564:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960632960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 665us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100469.401573:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1786100469.401682:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960632960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100469.401718:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960633088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786100469.401758:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100469.401817:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c450ad180 going to sleep for 11 seconds 00000100:00100000:3.0:1786100469.401903:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960633088 00000100:00100000:3.0:1786100469.401908:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960633088 00000100:00100000:3.0:1786100469.401940:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1786100469.401949:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960633088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786100469.402400:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960633088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 451us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100469.402423:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1786100469.402530:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960633088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100469.403299:0:8471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8471:1872861960633216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100469.403344:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100469.403422:0:8471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f5989c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100469.403606:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960633216 00000100:00100000:2.0:1786100469.403612:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960633216 00000100:00100000:2.0:1786100469.403675:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1786100469.403686:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:8471:x1872861960633216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100469.403886:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:8471:x1872861960633216:12345-0@lo:502:llog_process_th.0 Request processed in 201us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100469.403894:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1786100469.403982:0:8471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8471:1872861960633216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786100469.404020:0:8471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786100469.404029:0:8471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100469.404031:0:8471:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1786100469.404036:0:8471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1786100469.404056:0:8471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8471:1872861960633344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786100469.404088:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100469.404114:0:8471:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c450ad180 going to sleep for 11 seconds 00000100:00100000:2.0:1786100469.404305:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960633344 00000100:00100000:2.0:1786100469.404309:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960633344 00000100:00100000:2.0:1786100469.404345:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1786100469.404351:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:8471:x1872861960633344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100469.404495:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:8471:x1872861960633344:12345-0@lo:502:llog_process_th.0 Request processed in 144us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100469.404502:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1786100469.404638:0:8471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8471:1872861960633344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786100469.404695:0:8471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786100469.404700:0:8471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100469.404701:0:8471:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1786100469.404705:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1786100469.404848:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1786100469.404865:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1786100469.404874:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.404884:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100469.404894:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1786100469.404896:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a3c44f34d40 from 1 10000000:01000000:2.0:1786100469.404899:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786100469.404923:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b800/0x5564f2c20ac0d8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.404932:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b800/0x5564f2c20ac0d8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100469.404942:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b800/0x5564f2c20ac0d8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100469.404957:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960633472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786100469.404984:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100469.405191:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c480e8240 going to sleep for 11 seconds 00000100:00100000:1.0:1786100469.405470:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960633472 00000100:00100000:1.0:1786100469.405476:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960633472 00000100:00100000:1.0:1786100469.405539:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1786100469.405547:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960633472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786100469.405557:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100469.405569:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c62386000/0x5564f2c20ac0d95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0d8e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100469.405590:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62386000/0x5564f2c20ac0d95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0d8e expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100469.405600:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c62386000/0x5564f2c20ac0d95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0d8e expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100469.405609:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386000, rc 0) 00000100:00100000:1.0:1786100469.405693:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960633472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100469.405699:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1786100469.405778:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960633472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100469.405791:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b800/0x5564f2c20ac0d8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.405798:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b800/0x5564f2c20ac0d8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0d95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100469.405843:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960633600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786100469.405869:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100469.405896:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e840 going to sleep for 11 seconds 00000100:00100000:1.0:1786100469.405931:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960633600 00000100:00100000:1.0:1786100469.405935:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960633600 00000100:00100000:1.0:1786100469.405952:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1786100469.405957:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960633600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100469.406517:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960633600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 558us (645us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786100469.406525:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1786100469.406611:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960633600:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1786100469.406632:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1786100469.406639:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b800/0x5564f2c20ac0d8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100469.406647:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b800/0x5564f2c20ac0d8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100469.924906:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100470.093773:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100470.093916:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941731968 00000100:00100000:0.0:1786100470.093924:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941731968 00000100:00100000:0.0:1786100470.093976:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 162 00000100:00100000:0.0:1786100470.093984:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+8:5592:x1872861941731968:12345-192.168.206.53@tcp:101: 00010000:00010000:0.0:1786100470.094117:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100470.094136:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbba200/0x5564f2c20ac0d9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2e08 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100470.094174:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbba200/0x5564f2c20ac0d9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e08 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100470.094184:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbba200/0x5564f2c20ac0d9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e08 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100470.094193:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbba200, rc 0) 00000100:00100000:0.0:1786100470.094248:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+9:5592:x1872861941731968:12345-192.168.206.53@tcp:101: Request processed in 264us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100470.094255:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 162 00000100:00100000:0.0:1786100470.109568:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100470.113276:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941732096 00000100:00100000:2.0:1786100470.113290:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941732096 00000100:00100000:2.0:1786100470.113363:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 163 00000100:00100000:2.0:1786100470.113374:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+9:5592:x1872861941732096:12345-192.168.206.53@tcp:501: 00000100:00100000:2.0:1786100470.116795:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+9:5592:x1872861941732096:12345-192.168.206.53@tcp:501: Request processed in 3412us (7224us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100470.116809:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 163 00000100:00100000:3.0:1786100470.119688:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100470.119783:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941732224 00000100:00100000:0.0:1786100470.119792:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941732224 00000100:00100000:0.0:1786100470.119844:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 164 00000100:00100000:0.0:1786100470.119854:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+9:5592:x1872861941732224:12345-192.168.206.53@tcp:503: 00000100:00100000:0.0:1786100470.120216:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+9:5592:x1872861941732224:12345-192.168.206.53@tcp:503: Request processed in 362us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100470.120224:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 164 00000100:00100000:3.0:1786100470.128060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100470.129107:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941732352 00000100:00100000:2.0:1786100470.129122:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941732352 00000100:00100000:2.0:1786100470.129584:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 165 00000100:00100000:2.0:1786100470.129599:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+9:6078:x1872861941732352:12345-192.168.206.53@tcp:502: 00000100:00100000:2.0:1786100470.132910:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+9:6078:x1872861941732352:12345-192.168.206.53@tcp:502: Request processed in 3294us (4843us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100470.132931:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 165 00000100:00100000:3.0:1786100470.139720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100470.140084:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941732480 00000100:00100000:0.0:1786100470.140116:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941732480 00000100:00100000:0.0:1786100470.140190:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 166 00000100:00100000:0.0:1786100470.140210:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+9:6078:x1872861941732480:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786100470.140584:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+9:6078:x1872861941732480:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 383us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100470.140593:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 166 00000100:00100000:3.0:1786100470.144084:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100470.144276:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941732608 00000100:00100000:1.0:1786100470.144288:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941732608 00000100:00100000:1.0:1786100470.144360:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 167 00000100:00100000:1.0:1786100470.144373:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+9:5592:x1872861941732608:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786100470.144406:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100470.144435:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c62386c00/0x5564f2c20ac0da3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2e0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100470.144476:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62386c00/0x5564f2c20ac0da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e0f expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100470.144488:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c62386c00/0x5564f2c20ac0da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e0f expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100470.144499:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386c00, rc 0) 00000100:00100000:1.0:1786100470.144570:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:5592:x1872861941732608:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 200us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100470.144577:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 167 00000100:00100000:3.0:1786100470.146868:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100470.147246:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941732736 00000100:00100000:1.0:1786100470.147260:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941732736 00000100:00100000:1.0:1786100470.147329:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 168 00000100:00100000:1.0:1786100470.147341:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:5592:x1872861941732736:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100470.147952:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:5592:x1872861941732736:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 610us (1093us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786100470.147963:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 168 00010000:00010000:0.0:1786100470.949000:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786100471.415922:0:8509:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc3134d50 20000000:00000080:3.0:1786100471.415939:0:8509:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a3c7bddbc00 uarg=0000000000000000 20000000:01000000:3.0:1786100471.415981:0:8509:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786100471.415986:0:8509:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786100471.415991:0:8509:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1786100471.422977:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1786100471.429536:0:8509:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1786100471.434273:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1786100471.434332:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1786100471.434387:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1786100471.434405:0:8509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1786100471.434424:0:8509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100471.434442:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4165f800/0x5564f2c20ac0b1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0b18 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100471.434449:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0b81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0b7a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100471.434456:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0c45 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100471.434464:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0d09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2dd7 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100471.434471:0:8509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100471.434518:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0d09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2dd7 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100471.434532:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0d09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2dd7 expref: 9 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100471.434545:0:8509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1872861960633728:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100471.434947:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0c45 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100471.434957:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0c4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0c45 expref: 18 pid: 5838 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100471.434967:0:8509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1872861960633856:0@lo:104: 00000100:00100000:0.0:1786100471.435004:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786100471.435044:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0b81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0b7a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100471.435052:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0b81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0b7a expref: 18 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100471.435061:0:8509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1872861960633984:0@lo:104: 00000100:00100000:0.0:1786100471.435085:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786100471.435106:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4165f800/0x5564f2c20ac0b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0b18 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100471.435114:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c4165f800/0x5564f2c20ac0b1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0b18 expref: 18 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100471.435133:0:8509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f78a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1872861960634112:0@lo:104: 00000100:00100000:0.0:1786100471.435153:0:8509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f598480 going to sleep for 11 seconds 00000100:00100000:2.0:1786100471.435226:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1786100471.435245:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100471.435267:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960633856 00000100:00100000:2.0:1786100471.435273:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960633856 00000100:00100000:2.0:1786100471.435306:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960633984 00000100:00100000:2.0:1786100471.435310:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960633984 00000100:00100000:2.0:1786100471.435319:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960634112 00000100:00100000:2.0:1786100471.435321:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960634112 00000100:00100000:2.0:1786100471.435333:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786100471.435340:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:8509:x1872861960633856:12345-0@lo:104: 00010000:00010000:2.0:1786100471.435353:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0c4c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435400:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786100471.435413:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:8509:x1872861960633856:12345-0@lo:104: Request processed in 73us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100471.435420:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786100471.435436:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786100471.435441:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f513850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:8509:x1872861960633984:12345-0@lo:104: 00010000:00010000:2.0:1786100471.435448:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0b81 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435480:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786100471.435484:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f513850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:8509:x1872861960633984:12345-0@lo:104: Request processed in 44us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100471.435490:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786100471.435514:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786100471.435520:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:8509:x1872861960634112:12345-0@lo:104: 00010000:00010000:2.0:1786100471.435526:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac0b18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0b1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435557:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1786100471.435562:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:8509:x1872861960634112:12345-0@lo:104: Request processed in 42us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100471.435567:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1786100471.435587:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786100471.435593:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0c4c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435600:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c41510e00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:2.0:1786100471.435604:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0c4c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435623:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0c4c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786100471.435630:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0c4c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100471.435635:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786100471.435799:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c4c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435806:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786100471.435828:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c4c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435834:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c41510e00/0x5564f2c20ac0c45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0c4c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435847:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786100471.435850:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0b81 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435856:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f200 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:2.0:1786100471.435858:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0b81 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435865:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0b81 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786100471.435871:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0b81 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100471.435883:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786100471.435897:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b81 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435903:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786100471.435909:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b81 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435916:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac0b7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b81 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435925:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100471.435928:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac0b18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0b1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435933:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e400 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:2.0:1786100471.435936:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac0b18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0b1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435942:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac0b18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0b1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786100471.435947:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac0b18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0b1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100471.435951:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786100471.435962:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac0b18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435968:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786100471.435989:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac0b18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.435996:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac0b18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0b1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.436011:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100471.436013:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100471.436014:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100471.436021:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100471.436026:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100471.436037:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960634240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786100471.436065:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100471.436114:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786100471.436120:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960634368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786100471.436141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100471.436169:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960634496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786100471.436189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100471.436224:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960634240 00000100:00100000:2.0:1786100471.436228:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960634240 00010000:00010000:2.0:1786100471.436248:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0c4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0c45 expref: 19 pid: 5838 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100471.436262:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960634368 00000100:00100000:2.0:1786100471.436264:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960634368 00010000:00010000:2.0:1786100471.436274:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0b81 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0b7a expref: 20 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100471.436283:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960634496 00000100:00100000:2.0:1786100471.436285:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960634496 00010000:00010000:2.0:1786100471.436303:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4165f800/0x5564f2c20ac0b1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0b18 expref: 21 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100471.436317:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786100471.436324:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+21:3305:x1872861960634240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786100471.436334:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100471.436338:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0c4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0c45 expref: 21 pid: 5838 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.436346:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0c4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0c45 expref: 21 pid: 5838 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.436360:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100471.436388:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+21:3305:x1872861960634240:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100471.436395:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786100471.436406:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786100471.436413:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+20:3305:x1872861960634368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786100471.436420:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100471.436424:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0b81 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0b7a expref: 20 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.436431:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0b81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0b7a expref: 20 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.436440:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100471.436460:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+20:3305:x1872861960634368:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100471.436466:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786100471.436486:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786100471.436492:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960634496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786100471.436499:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100471.436504:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4165f800/0x5564f2c20ac0b1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0b18 expref: 19 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.436511:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4165f800/0x5564f2c20ac0b1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0b18 expref: 19 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.436520:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100471.436546:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960634496:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100471.436552:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786100471.436589:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960634496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786100471.436610:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960634368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786100471.436616:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960634240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786100471.439954:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0c4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0c45 expref: 18 pid: 5838 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100471.439974:0:8509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1872861960633856:0@lo:104: 00010000:00010000:0.0:1786100471.439986:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4165fa00/0x5564f2c20ac0b81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0b7a expref: 17 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100471.439995:0:8509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1872861960633984:0@lo:104: 00010000:00010000:0.0:1786100471.440004:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4165f800/0x5564f2c20ac0b1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0b18 expref: 16 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100471.440011:0:8509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f78a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1872861960634112:0@lo:104: 00000100:00100000:3.0:1786100471.449955:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100471.450238:0:8509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1872861960633728:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100471.450267:0:8509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100471.450394:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941732864 00000100:00100000:2.0:1786100471.450400:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941732864 00010000:00010000:2.0:1786100471.450431:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0d09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2dd7 expref: 10 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100471.450470:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:2.0:1786100471.450479:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d69173c-d092-48de-a520-1459f9171aec+10:2352:x1872861941732864:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100471.450494:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100471.450499:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0d09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2dd7 expref: 10 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.450526:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0d09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2dd7 expref: 10 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.450543:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0d09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2dd7 expref: 10 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.450558:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.450566:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.450580:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.450586:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.450593:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.450599:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.450605:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbe00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100471.450609:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.450615:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100471.456296:0:8509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100471.456313:0:8509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.459296:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.459315:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbbbe00/0x5564f2c20ac0daa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100471.459342:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100471.459425:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d69173c-d092-48de-a520-1459f9171aec+9:2352:x1872861941732864:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 8942us (9474us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100471.459435:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:2.0:1786100471.498171:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100471.498323:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941732992 00000100:00100000:0.0:1786100471.498332:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941732992 00000100:00100000:0.0:1786100471.498387:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 169 00000100:00100000:0.0:1786100471.498397:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+9:5592:x1872861941732992:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786100471.498414:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100471.498431:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbb800/0x5564f2c20ac0db1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2e16 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100471.498472:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbb800/0x5564f2c20ac0db1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e16 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100471.498483:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbbb800/0x5564f2c20ac0db1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e16 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100471.498493:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb800, rc 0) 00000100:00100000:0.0:1786100471.498542:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+10:5592:x1872861941732992:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 147us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100471.498549:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 169 00000100:00100000:2.0:1786100471.501493:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100471.501571:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941733120 00000100:00100000:1.0:1786100471.501584:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941733120 00000100:00100000:1.0:1786100471.501697:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 170 00000100:00100000:1.0:1786100471.501712:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:5592:x1872861941733120:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100471.502091:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:5592:x1872861941733120:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 384us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100471.502099:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 170 00000100:00100000:0.0:1786100471.540092:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100471.540157:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941733248 00000100:00100000:2.0:1786100471.540166:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941733248 00000100:00100000:2.0:1786100471.540216:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 171 00000100:00100000:2.0:1786100471.540226:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+10:5592:x1872861941733248:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100471.540430:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+10:5592:x1872861941733248:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 204us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100471.540438:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 171 00000100:00100000:3.0:1786100471.566130:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100471.566362:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941733376 00000100:00100000:1.0:1786100471.566371:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941733376 00000100:00100000:1.0:1786100471.566423:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 172 00000100:00100000:1.0:1786100471.566432:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:6101:x1872861941733376:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786100471.566637:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:6101:x1872861941733376:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 205us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100471.566677:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 172 00000100:00100000:3.0:1786100471.571284:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100471.571362:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941733504 00000100:00100000:0.0:1786100471.571371:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941733504 00000100:00100000:0.0:1786100471.571421:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 173 00000100:00100000:0.0:1786100471.571431:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+10:6101:x1872861941733504:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786100471.571688:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+10:6101:x1872861941733504:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 257us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100471.571696:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 173 00010000:00010000:2.0:1786100471.973200:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100472.229010:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786100472.232104:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960634752:0@lo:400:kworker.0 00000100:00100000:3.0:1786100472.232191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100472.232248:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786100472.232255:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960634880:0@lo:400:kworker.0 00000100:00100000:3.0:1786100472.232277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100472.232312:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960634752 00000100:00100000:3.0:1786100472.232318:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960634752 00000100:00100000:3.0:1786100472.232362:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960634880 00000100:00100000:3.0:1786100472.232365:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960634880 00000100:00100000:3.0:1786100472.232405:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786100472.232413:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960634752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100472.232461:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960634752:12345-0@lo:400:kworker.0 Request processed in 49us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100472.232468:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786100472.232482:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786100472.232490:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960634880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100472.232516:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960634880:12345-0@lo:400:kworker.0 Request processed in 28us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100472.232522:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786100472.232555:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960634880:0@lo:400:kworker.0 00000100:00100000:3.0:1786100472.232578:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960634752:0@lo:400:kworker.0 00000100:00100000:1.0:1786100472.234826:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960635008:0@lo:400:kworker.0 00000100:00100000:1.0:1786100472.234896:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100472.234938:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960635008 00000100:00100000:1.0:1786100472.234944:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960635008 00000100:00100000:1.0:1786100472.234989:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786100472.234998:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960635008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100472.235038:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960635008:12345-0@lo:400:kworker.0 Request processed in 42us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100472.235045:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1786100472.235088:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c74f0e300 x1872861960635008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100472.235102:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960635008:0@lo:400:kworker.0 00000100:00100000:1.0:1786100472.235108:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960634624:0@lo:400:kworker.0 00000100:00100000:1.0:1786100472.235134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100472.235156:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960634624 00000100:00100000:1.0:1786100472.235160:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960634624 00000100:00100000:1.0:1786100472.235185:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1786100472.235191:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:3307:x1872861960634624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100472.235220:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:3307:x1872861960634624:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100472.235225:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1786100472.235261:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960634624:0@lo:400:kworker.0 00000100:00080000:2.0:1786100472.238192:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786100472.238199:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100472.238207:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786100472.238246:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960635264:0@lo:400:kworker.0 00000100:00100000:2.0:1786100472.238306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100472.238346:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960635264 00000100:00100000:2.0:1786100472.238353:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960635264 00000100:00100000:2.0:1786100472.238412:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786100472.238422:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960635264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100472.238470:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960635264:12345-0@lo:400:kworker.0 Request processed in 51us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100472.238477:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1786100472.238495:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1786100472.238518:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c74f0df80 x1872861960635264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100472.238532:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960635264:0@lo:400:kworker.0 00000100:00100000:2.0:1786100472.238553:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960635136:0@lo:400:kworker.0 00000100:00100000:2.0:1786100472.238579:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100472.238609:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960635136 00000100:00100000:2.0:1786100472.238614:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960635136 00000100:00100000:2.0:1786100472.238674:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786100472.238681:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960635136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100472.238992:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960635136:12345-0@lo:400:kworker.0 Request processed in 310us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100472.238998:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1786100472.239015:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100472.239032:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960635136:0@lo:400:kworker.0 00000100:00100000:3.0:1786100472.742925:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960635392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100472.742992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100472.743062:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960635392 00000100:00100000:3.0:1786100472.743069:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960635392 00000100:00100000:3.0:1786100472.743108:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786100472.743116:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960635392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786100472.743145:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100472.743184:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960635392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100472.743190:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1786100472.743226:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c50d88380 x1872861960635392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100472.743242:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960635392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100472.743340:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786100472.743351:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960635520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100472.743395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100472.743424:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960635520 00000100:00100000:1.0:1786100472.743428:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960635520 00000100:00100000:1.0:1786100472.743451:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786100472.743457:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960635520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100472.743477:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100472.743507:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960635520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100472.743513:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1786100472.743538:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d3b80 x1872861960635520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100472.743550:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960635520:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1786100472.933212:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786100472.933221:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c7f9ee000 from 4 10000000:01000000:0.0:1786100472.933226:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786100472.933274:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100472.933285:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100472.933314:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100472.933342:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960635648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786100472.933419:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100472.933491:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583e4540 going to sleep for 11 seconds 00000100:00100000:1.0:1786100472.933854:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960635648 00000100:00100000:1.0:1786100472.933862:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960635648 00000100:00100000:1.0:1786100472.933921:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1786100472.933930:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960635648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786100472.933943:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100472.933957:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c62386600/0x5564f2c20ac0dbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0db8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100472.933980:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62386600/0x5564f2c20ac0dbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0db8 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100472.933990:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c62386600/0x5564f2c20ac0dbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0db8 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100472.934009:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386600, rc 0) 00000100:00100000:1.0:1786100472.934060:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960635648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100472.934067:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1786100472.934325:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960635648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786100472.934340:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0dbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100472.934350:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0dbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100472.934427:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960635776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100472.934459:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100472.934490:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583e4540 going to sleep for 11 seconds 00000100:00100000:1.0:1786100472.934543:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960635776 00000100:00100000:1.0:1786100472.934549:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960635776 00000100:00100000:1.0:1786100472.934581:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1786100472.934588:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960635776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100472.935052:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960635776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 462us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100472.935059:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1786100472.935304:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960635776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100472.935336:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960635904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100472.935389:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100472.935418:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583e4540 going to sleep for 11 seconds 00000100:00100000:1.0:1786100472.935596:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960635904 00000100:00100000:1.0:1786100472.935602:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960635904 00000100:00100000:1.0:1786100472.935635:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1786100472.936078:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960635904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786100472.936239:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960635904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100472.936296:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960635904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100472.940100:0:8577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8577:1872861960636032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100472.940184:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100472.940236:0:8577:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736900 going to sleep for 11 seconds 00000100:00100000:0.0:1786100472.940339:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960636032 00000100:00100000:0.0:1786100472.940346:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960636032 00000100:00100000:1.0:1786100472.948629:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1786100472.953757:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1786100472.953782:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:8577:x1872861960636032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100472.954067:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:8577:x1872861960636032:12345-0@lo:502:llog_process_th.0 Request processed in 297us (13882us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100472.954076:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1786100472.954274:0:8577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8577:1872861960636032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786100472.954319:0:8577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100472.954329:0:8577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100472.954331:0:8577:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1786100472.954341:0:8577:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a3c7f9ee000 00000020:00000080:0.0:1786100472.954344:0:8577:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1786100472.954533:0:8577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8577:1872861960636160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100472.954578:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100472.954616:0:8577:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583e4540 going to sleep for 11 seconds 00000100:00100000:1.0:1786100472.954745:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960636160 00000100:00100000:1.0:1786100472.954752:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960636160 00000100:00100000:1.0:1786100472.954799:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1786100472.954808:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:8577:x1872861960636160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786100472.954958:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:8577:x1872861960636160:12345-0@lo:502:llog_process_th.0 Request processed in 150us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100472.954965:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1786100472.955089:0:8577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8577:1872861960636160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786100472.955110:0:8577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100472.955115:0:8577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100472.955117:0:8577:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1786100472.955122:0:8577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1786100472.955348:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1786100472.955365:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786100472.955373:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0dbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100472.955384:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0dbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100472.955393:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786100472.955395:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c6e163000 from 4 10000000:01000000:1.0:1786100472.955398:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786100472.955422:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100472.955429:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100472.955438:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100472.955454:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960636288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786100472.955485:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100472.955517:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7c233a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786100472.955571:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960636288 00000100:00100000:3.0:1786100472.955577:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960636288 00000100:00100000:3.0:1786100472.955610:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1786100472.955618:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960636288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100472.955628:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100472.955684:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0dcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0dc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100472.955706:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0dc6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100472.955716:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0dc6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100472.955733:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c41511000, rc 0) 00000100:00100000:3.0:1786100472.955769:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960636288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100472.955775:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1786100472.955970:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960636288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786100472.955984:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0dcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100472.955992:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0dcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100472.956038:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960636416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100472.956066:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100472.956090:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583e4540 going to sleep for 11 seconds 00000100:00100000:0.0:1786100472.956102:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960636416 00000100:00100000:0.0:1786100472.956105:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960636416 00000100:00100000:0.0:1786100472.956131:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1786100472.956138:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960636416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100472.956387:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960636416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100472.956395:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1786100472.956427:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960636416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100472.956454:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960636544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100472.956492:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100472.956506:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583e4540 going to sleep for 11 seconds 00000100:00100000:0.0:1786100472.956518:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960636544 00000100:00100000:0.0:1786100472.956522:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960636544 00000100:00100000:0.0:1786100472.956539:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1786100472.956545:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960636544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100472.956826:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960636544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100472.956834:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1786100472.956870:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960636544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786100472.957989:0:8578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8578:1872861960636672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786100472.958047:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100472.958084:0:8578:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7c2330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100472.958134:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960636672 00000100:00100000:0.0:1786100472.958141:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960636672 00000100:00100000:0.0:1786100472.958187:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1786100472.958321:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:8578:x1872861960636672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100472.958514:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:8578:x1872861960636672:12345-0@lo:502:llog_process_th.0 Request processed in 196us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100472.958572:0:8578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8578:1872861960636672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786100472.958600:0:8578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786100472.958610:0:8578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100472.958618:0:8578:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1786100472.958625:0:8578:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a3c6e163000 00000020:00000080:1.0:1786100472.958627:0:8578:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1786100472.958725:0:8578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8578:1872861960636800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786100472.958759:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100472.958781:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960636800 00000100:00100000:1.0:1786100472.958785:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960636800 00000100:00100000:0.0:1786100472.961928:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1786100472.962597:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1786100472.962613:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:8578:x1872861960636800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786100472.962859:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:8578:x1872861960636800:12345-0@lo:502:llog_process_th.0 Request processed in 252us (4098us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100472.962867:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1786100472.962964:0:8578:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7c2330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100472.962988:0:8578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8578:1872861960636800:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786100472.963029:0:8578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100472.963037:0:8578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100472.963039:0:8578:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1786100472.963046:0:8578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1786100472.963096:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1786100472.963111:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786100472.963120:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0dcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100472.963130:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0dcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100472.963140:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786100472.963142:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c47abb000 from 4 10000000:01000000:0.0:1786100472.963145:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786100472.963169:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100472.963178:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100472.963187:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100472.963219:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960636928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786100472.963255:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100472.965690:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c48c5d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100472.966002:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960636928 00000100:00100000:3.0:1786100472.966012:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960636928 00000100:00100000:3.0:1786100472.966050:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1786100472.966059:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960636928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100472.966073:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100472.966088:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0ddb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0dd4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100472.966114:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0ddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0dd4 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100472.966125:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0ddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0dd4 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100472.966134:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c41511200, rc 0) 00000100:00100000:3.0:1786100472.966201:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960636928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (2933us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100472.966208:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1786100472.966245:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960636928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100472.966260:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ddb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100472.966268:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0ddb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100472.966341:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960637056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786100472.966377:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100472.966386:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e840 going to sleep for 11 seconds 00000100:00100000:3.0:1786100472.966403:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960637056 00000100:00100000:3.0:1786100472.966407:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960637056 00000100:00100000:3.0:1786100472.966424:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1786100472.966430:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960637056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786100472.966691:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960637056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100472.966698:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1786100472.966717:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960637056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786100472.966744:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960637184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786100472.966784:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100472.966794:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4700e840 going to sleep for 11 seconds 00000100:00100000:3.0:1786100472.966810:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960637184 00000100:00100000:3.0:1786100472.966814:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960637184 00000100:00100000:3.0:1786100472.966830:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1786100472.966835:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960637184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786100472.966962:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960637184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100472.966969:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1786100472.966995:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960637184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100472.971909:0:8581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8581:1872861960637312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100472.971986:0:8581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100472.972038:0:8581:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c48c5d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100472.973318:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960637312 00000100:00100000:3.0:1786100472.973334:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960637312 00000100:00100000:3.0:1786100472.973385:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1786100472.973394:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:8581:x1872861960637312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100472.973605:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:8581:x1872861960637312:12345-0@lo:502:llog_process_th.0 Request processed in 211us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100472.973612:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1786100472.981013:0:8581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8581:1872861960637312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786100472.981073:0:8581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100472.981083:0:8581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100472.981085:0:8581:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1786100472.981096:0:8581:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a3c47abb000 00000020:00000080:0.0:1786100472.981098:0:8581:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1786100472.981753:0:8581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8581:1872861960637440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100472.981821:0:8581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100472.981858:0:8581:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c51e77600 going to sleep for 11 seconds 00000100:00100000:2.0:1786100472.982324:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960637440 00000100:00100000:2.0:1786100472.982331:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960637440 00000100:00100000:2.0:1786100472.982383:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1786100472.982392:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:8581:x1872861960637440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100472.982802:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:8581:x1872861960637440:12345-0@lo:502:llog_process_th.0 Request processed in 410us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100472.982810:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1786100472.983387:0:8581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:8581:1872861960637440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786100472.983416:0:8581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100472.983423:0:8581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100472.983425:0:8581:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1786100472.983432:0:8581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1786100472.983770:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1786100472.983791:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786100472.983801:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ddb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100472.983812:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0ddb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100472.996801:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100473.999958:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100474.000006:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100474.000032:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100474.000099:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100474.000210:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941733888 00000100:00100000:1.0:1786100474.000222:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941733888 00000100:00100000:1.0:1786100474.000304:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941734016 00000100:00100000:1.0:1786100474.000308:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941734016 00000100:00100000:1.0:1786100474.000330:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:1.0:1786100474.000341:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2353:x1872861941733888:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100474.000431:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2353:x1872861941733888:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 91us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100474.000439:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:1.0:1786100474.000458:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:1.0:1786100474.000464:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2353:x1872861941734016:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100474.000489:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2353:x1872861941734016:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 26us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100474.000496:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:3.0:1786100474.000594:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941733760 00000100:00100000:3.0:1786100474.000599:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941733760 00000100:00100000:3.0:1786100474.001001:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 30 00000100:00100000:3.0:1786100474.001011:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941733760:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100474.001051:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941733760:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 43us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100474.001057:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 30 00000100:00100000:2.0:1786100474.002075:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941733632 00000100:00100000:2.0:1786100474.002089:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941733632 00000100:00080000:0.0:1786100474.002153:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786100474.002164:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786100474.002170:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 190 00000100:00080000:0.0:1786100474.002171:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786100474.002188:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+10:2353:x1872861941733632:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100474.002278:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+10:2353:x1872861941733632:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 93us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100474.002285:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 190 00010000:00010000:2.0:1786100474.021018:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100475.047014:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100476.070025:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100477.095757:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100477.357551:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960637568:0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.357626:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100477.357686:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960638080:0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.357712:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100477.357744:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786100477.357750:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960637952:0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.357773:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100477.357802:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960637696:0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.357824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100477.357840:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960638208:0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.357860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100477.357877:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786100477.357883:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960637824:0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.357901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100477.357928:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960637568 00000100:00100000:1.0:1786100477.357934:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960637568 00000100:00100000:1.0:1786100477.357971:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1786100477.357980:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960637568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.358026:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960637568:12345-0@lo:400:kworker.0 Request processed in 48us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100477.358033:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1786100477.358062:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960637952 00000100:00100000:1.0:1786100477.358065:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960637952 00000100:00100000:1.0:1786100477.358096:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960638208 00000100:00100000:1.0:1786100477.358099:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960638208 00000100:00100000:1.0:1786100477.358113:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786100477.358127:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960637952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.358159:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960637952:12345-0@lo:400:kworker.0 Request processed in 33us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100477.358165:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786100477.358175:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786100477.358181:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960638208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.358210:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960638208:12345-0@lo:400:kworker.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100477.358216:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786100477.358232:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960638080 00000100:00100000:1.0:1786100477.358235:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960638080 00000100:00100000:1.0:1786100477.358252:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960637696 00000100:00100000:1.0:1786100477.358254:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960637696 00000100:00100000:1.0:1786100477.358264:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960637824 00000100:00100000:1.0:1786100477.358266:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960637824 00000100:00100000:1.0:1786100477.358278:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786100477.358284:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960638080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.358314:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960638080:12345-0@lo:400:kworker.0 Request processed in 29us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100477.358320:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786100477.358330:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786100477.358335:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960637696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.358360:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960637696:12345-0@lo:400:kworker.0 Request processed in 24us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100477.358365:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786100477.358376:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786100477.358382:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960637824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.358418:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960637824:12345-0@lo:400:kworker.0 Request processed in 35us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100477.358424:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1786100477.358447:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786100477.358452:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786100477.358454:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786100477.358479:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d0380 x1872861960637952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100477.358493:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960637952:0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.358501:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960637568:0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.358510:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960638080:0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.358535:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960637824:0@lo:400:kworker.0 00000100:00100000:1.0:1786100477.358543:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960637696:0@lo:400:kworker.0 00010000:00080000:1.0:1786100477.358552:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d1f80 x1872861960638208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100477.358559:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960638208:0@lo:400:kworker.0 00000001:02000400:3.0:1786100477.745352:0:8809:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1786100477.861929:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786100477.861961:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960638336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100477.862024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100477.862099:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960638336 00000100:00100000:1.0:1786100477.862105:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960638336 00000100:00100000:1.0:1786100477.862173:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786100477.862182:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960638336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786100477.862221:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100477.862263:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960638336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100477.862270:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786100477.862291:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960638464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100477.862312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100477.862344:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960638464 00000100:00100000:1.0:1786100477.862348:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960638464 00000100:00100000:1.0:1786100477.862364:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786100477.862370:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960638464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100477.862387:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100477.862418:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960638464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100477.862424:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1786100477.862452:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c74f0f800 x1872861960638336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100477.862470:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960638336:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1786100477.862493:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d1500 x1872861960638464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100477.862504:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960638464:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786100478.117248:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100479.120110:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100479.120149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100479.120184:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100479.120212:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100479.120237:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941734144 00000100:00100000:0.0:1786100479.120250:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941734144 00000100:00100000:0.0:1786100479.120295:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 192 00000100:00100000:0.0:1786100479.120304:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+10:2354:x1872861941734144:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100479.120366:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+10:2354:x1872861941734144:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 62us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100479.120374:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 192 00000100:00100000:0.0:1786100479.120405:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941734528 00000100:00100000:0.0:1786100479.120408:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941734528 00000100:00100000:0.0:1786100479.120439:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941734400 00000100:00100000:0.0:1786100479.120442:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941734400 00000100:00100000:0.0:1786100479.120458:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:0.0:1786100479.120464:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941734528:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100479.120491:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941734528:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100479.120498:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:0.0:1786100479.120510:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:0.0:1786100479.120516:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941734400:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100479.120538:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941734400:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 22us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100479.120543:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00080000:0.0:1786100479.120687:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786100479.120692:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786100479.122776:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941734272 00000100:00100000:1.0:1786100479.122786:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941734272 00000100:00100000:1.0:1786100479.122847:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:1.0:1786100479.122857:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941734272:12345-192.168.206.53@tcp:400:kworker.0 00000100:00080000:2.0:1786100479.122866:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100479.122938:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941734272:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 81us (2833us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100479.122946:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 34 00010000:00010000:2.0:1786100479.146073:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100480.166774:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100481.189862:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100482.213900:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100482.470906:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960638976:0@lo:400:kworker.0 00000100:00100000:3.0:1786100482.470967:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100482.471026:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786100482.471032:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960638592:0@lo:400:kworker.0 00000100:00100000:3.0:1786100482.471067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100482.471089:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960639104:0@lo:400:kworker.0 00000100:00100000:3.0:1786100482.471108:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100482.471130:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960638848:0@lo:400:kworker.0 00000100:00100000:3.0:1786100482.471148:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100482.471162:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786100482.471166:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960638720:0@lo:400:kworker.0 00000100:00100000:3.0:1786100482.471191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100482.471204:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960639232:0@lo:400:kworker.0 00000100:00100000:3.0:1786100482.471227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100482.471252:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960638592 00000100:00100000:3.0:1786100482.471258:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960638592 00000100:00100000:3.0:1786100482.471293:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1786100482.471300:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960638592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100482.471339:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960638592:12345-0@lo:400:kworker.0 Request processed in 39us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100482.471345:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1786100482.471369:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960639104 00000100:00100000:3.0:1786100482.471372:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960639104 00000100:00100000:3.0:1786100482.471393:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960638848 00000100:00100000:0.0:1786100482.471493:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960638976 00000100:00100000:0.0:1786100482.471498:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960638976 00000100:00100000:0.0:1786100482.471523:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960639232 00000100:00100000:0.0:1786100482.471526:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960639232 00000100:00100000:0.0:1786100482.471550:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786100482.471556:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960638976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100482.471599:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960638976:12345-0@lo:400:kworker.0 Request processed in 43us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100482.471605:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786100482.471617:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786100482.471623:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960639232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100482.471671:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960639232:12345-0@lo:400:kworker.0 Request processed in 48us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100482.471677:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786100482.471736:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960638848 00000100:00100000:3.0:1786100482.471755:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960638720 00000100:00100000:3.0:1786100482.471757:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960638720 00000100:00100000:3.0:1786100482.471767:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1786100482.471772:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960639104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100482.471799:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960639104:12345-0@lo:400:kworker.0 Request processed in 27us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100482.471805:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1786100482.471813:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1786100482.471818:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960638848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100482.471836:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960638848:12345-0@lo:400:kworker.0 Request processed in 18us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100482.471841:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1786100482.471849:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1786100482.471860:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960638720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100482.471881:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960638720:12345-0@lo:400:kworker.0 Request processed in 22us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100482.471886:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1786100482.471908:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786100482.471912:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786100482.471914:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100482.471946:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960638720:0@lo:400:kworker.0 00010000:00080000:3.0:1786100482.471957:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429ac700 x1872861960639232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100482.471967:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960639232:0@lo:400:kworker.0 00000100:00100000:3.0:1786100482.471974:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960638848:0@lo:400:kworker.0 00000100:00100000:3.0:1786100482.471999:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960638592:0@lo:400:kworker.0 00000100:00100000:3.0:1786100482.472007:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960639104:0@lo:400:kworker.0 00010000:00080000:3.0:1786100482.472015:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429aea00 x1872861960638976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100482.472023:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960638976:0@lo:400:kworker.0 00000100:00100000:0.0:1786100482.981768:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960639360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100482.981832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100482.981913:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960639360 00000100:00100000:0.0:1786100482.981920:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960639360 00000100:00100000:0.0:1786100482.981960:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786100482.981968:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960639360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786100482.981999:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100482.982043:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960639360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100482.982049:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1786100482.982087:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429aed80 x1872861960639360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100482.982104:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960639360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786100482.982220:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786100482.982231:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960639488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786100482.982259:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100482.982286:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960639488 00000100:00100000:2.0:1786100482.982290:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960639488 00000100:00100000:2.0:1786100482.982314:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786100482.982321:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960639488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786100482.982339:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100482.982371:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960639488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100482.982377:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1786100482.982402:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c74f0ce00 x1872861960639488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100482.982414:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960639488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786100483.237044:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786100483.474997:0:9053:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing yml_node 00000100:00100000:3.0:1786100484.239821:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100484.239857:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100484.239881:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100484.239907:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100484.239934:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941734912 00000100:00100000:3.0:1786100484.239943:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941734912 00000100:00100000:3.0:1786100484.239990:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941735040 00000100:00100000:3.0:1786100484.240005:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941735040 00000100:00100000:3.0:1786100484.240028:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:3.0:1786100484.240037:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2350:x1872861941734912:12345-192.168.206.53@tcp:9:kworker.0 00000020:00000080:3.0:1786100484.240069:0:6684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0d17 00000100:00080000:3.0:1786100484.240079:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9a3c4514b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786100484.240113:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1786100484.240412:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+2:2350:x1872861941734912:12345-192.168.206.53@tcp:9:kworker.0 Request processed in 375us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100484.240420:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:3.0:1786100484.240435:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:3.0:1786100484.240442:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2350:x1872861941735040:12345-192.168.206.53@tcp:9:kworker.0 00000020:00000080:3.0:1786100484.240454:0:6684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0d1e 00000100:00080000:3.0:1786100484.240460:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9a3c45149000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786100484.240479:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1786100484.240700:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+2:2350:x1872861941735040:12345-192.168.206.53@tcp:9:kworker.0 Request processed in 257us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100484.240707:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:3.0:1786100484.240725:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941734784 00000100:00100000:3.0:1786100484.240729:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941734784 00000100:00100000:3.0:1786100484.240758:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:3.0:1786100484.240765:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941734784:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100484.240793:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941734784:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 28us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100484.240800:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00080000:3.0:1786100484.240816:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786100484.240820:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786100484.240828:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786100484.240885:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100484.240985:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100484.241069:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941734656 00000100:00100000:1.0:1786100484.241074:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941734656 00000100:00100000:1.0:1786100484.241102:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 194 00000100:00100000:1.0:1786100484.241109:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:2353:x1872861941734656:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100484.241143:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:2353:x1872861941734656:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 35us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100484.241149:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 194 00010000:00010000:2.0:1786100484.264736:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100485.284850:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100486.308726:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786100486.702531:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d2a93440-3d3b-4616-8388-e39125c10990 00000020:00000080:1.0:1786100486.702539:0:6708:0:(genops.c:906:class_export_put()) final put ffff9a3c4514e800/d2a93440-3d3b-4616-8388-e39125c10990 00000020:00000080:0.0:1786100486.702606:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c4514e800/d2a93440-3d3b-4616-8388-e39125c10990 for lustre-OST0000 00000020:00000080:0.0:1786100486.702678:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c4514b800 for lustre-OST0000 00010000:00010000:2.0:1786100487.339271:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786100487.426937:0:9248:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.56.50 00000100:00100000:3.0:1786100487.589183:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960639616:0@lo:400:kworker.0 00000100:00100000:3.0:1786100487.589253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100487.589306:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960640128:0@lo:400:kworker.0 00000100:00100000:3.0:1786100487.589330:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100487.589354:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786100487.589359:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960640000:0@lo:400:kworker.0 00000100:00100000:3.0:1786100487.589378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100487.589414:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960640128 00000100:00100000:3.0:1786100487.589421:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960640128 00000100:00100000:3.0:1786100487.589460:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1786100487.589481:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960640128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100487.589526:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960640128:12345-0@lo:400:kworker.0 Request processed in 46us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100487.589532:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1786100487.589570:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960640000 00000100:00100000:3.0:1786100487.589574:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960640000 00000100:00100000:3.0:1786100487.589595:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786100487.589600:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960640000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100487.589628:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960640000:12345-0@lo:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100487.589633:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1786100487.589646:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786100487.591778:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786100487.592113:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d0380 x1872861960640000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100487.592129:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960640000:0@lo:400:kworker.0 00000100:00100000:3.0:1786100487.592143:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960640128:0@lo:400:kworker.0 00000100:00100000:1.0:1786100487.592296:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960639616 00000100:00100000:1.0:1786100487.592303:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960639616 00000100:00100000:1.0:1786100487.592343:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1786100487.592352:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960639616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100487.592434:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960639616:12345-0@lo:400:kworker.0 Request processed in 83us (3181us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100487.592441:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1786100487.592579:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960639744:0@lo:400:kworker.0 00000100:00100000:0.0:1786100487.592616:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100487.592640:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960640256:0@lo:400:kworker.0 00000100:00100000:0.0:1786100487.592705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100487.592728:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786100487.592734:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960639872:0@lo:400:kworker.0 00000100:00100000:0.0:1786100487.592754:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100487.592793:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960640256 00000100:00100000:0.0:1786100487.592797:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960640256 00000100:00100000:0.0:1786100487.592828:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786100487.592835:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960640256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100487.592882:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960640256:12345-0@lo:400:kworker.0 Request processed in 48us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100487.592888:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786100487.592909:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960639744 00000100:00100000:0.0:1786100487.592912:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960639744 00000100:00100000:0.0:1786100487.592929:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960639872 00000100:00100000:0.0:1786100487.592932:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960639872 00000100:00100000:0.0:1786100487.592945:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786100487.592950:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960639744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100487.592978:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960639744:12345-0@lo:400:kworker.0 Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100487.592983:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786100487.592993:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786100487.592998:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960639872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100487.593022:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960639872:12345-0@lo:400:kworker.0 Request processed in 24us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100487.593038:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786100487.593064:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960639872:0@lo:400:kworker.0 00000100:00100000:0.0:1786100487.593072:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960639744:0@lo:400:kworker.0 00010000:00080000:0.0:1786100487.593081:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d2a00 x1872861960640256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100487.593089:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960640256:0@lo:400:kworker.0 00000100:00080000:0.0:1786100487.593107:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786100487.593111:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786100487.593834:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960639616:0@lo:400:kworker.0 00000100:00100000:3.0:1786100488.104632:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786100488.104671:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960640384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100488.104741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100488.104798:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960640384 00000100:00100000:3.0:1786100488.104805:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960640384 00000100:00100000:3.0:1786100488.104846:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786100488.104854:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960640384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786100488.104885:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100488.104926:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960640384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100488.104934:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1786100488.104972:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b42514700 x1872861960640384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100488.104989:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960640384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100488.108326:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960640512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100488.108393:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100488.108456:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960640512 00000100:00100000:3.0:1786100488.108463:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960640512 00000100:00100000:3.0:1786100488.108504:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1786100488.108520:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960640512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786100488.108567:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100488.108612:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960640512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100488.108618:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1786100488.108682:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d0700 x1872861960640512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100488.108823:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960640512:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786100488.359945:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786100488.694319:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2a93440-3d3b-4616-8388-e39125c10990 00000020:00000080:2.0:1786100488.694327:0:7635:0:(genops.c:906:class_export_put()) final put ffff9a3c45148000/d2a93440-3d3b-4616-8388-e39125c10990 00000020:00000080:0.0:1786100488.694389:0:467:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c45148000/d2a93440-3d3b-4616-8388-e39125c10990 for lustre-OST0001 00000020:00000080:0.0:1786100488.708338:0:467:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c45149000 for lustre-OST0001 00000100:00100000:3.0:1786100489.354027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100489.354076:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100489.354223:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941735168 00000100:00100000:2.0:1786100489.354232:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941735168 00000100:00100000:2.0:1786100489.354288:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 196 00000100:00100000:2.0:1786100489.354298:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+10:2351:x1872861941735168:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100489.354378:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+10:2351:x1872861941735168:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 82us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100489.354387:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 196 00000100:00100000:0.0:1786100489.354645:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941735296 00000100:00100000:0.0:1786100489.354670:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941735296 00000100:00100000:0.0:1786100489.354717:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:0.0:1786100489.354725:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941735296:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100489.354760:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941735296:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 36us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100489.354767:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00080000:1.0:1786100489.354830:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786100489.380829:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100490.413851:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786100490.568728:0:9345:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.56.50 00010000:00010000:2.0:1786100491.429303:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100492.458925:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100492.708981:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960640768:0@lo:400:kworker.0 00000100:00100000:1.0:1786100492.709086:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100492.709162:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960641280:0@lo:400:kworker.0 00000100:00100000:1.0:1786100492.709212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100492.709265:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786100492.709272:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960640896:0@lo:400:kworker.0 00000100:00100000:1.0:1786100492.709298:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100492.709338:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960640768 00000100:00100000:1.0:1786100492.709347:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960640768 00000100:00100000:2.0:1786100492.709361:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960640640:0@lo:400:kworker.0 00000100:00100000:1.0:1786100492.709397:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960640896 00000100:00100000:1.0:1786100492.709401:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960640896 00000100:00100000:2.0:1786100492.709407:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100492.709444:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1786100492.709445:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960641152:0@lo:400:kworker.0 00000100:00100000:1.0:1786100492.709460:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960640768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100492.709477:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100492.709482:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960641024:0@lo:400:kworker.0 00000100:00100000:1.0:1786100492.709538:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960640768:12345-0@lo:400:kworker.0 Request processed in 81us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100492.709549:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100492.709550:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786100492.709573:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786100492.709581:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960640896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100492.709600:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960641280 00000100:00100000:0.0:1786100492.709607:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960641280 00000100:00100000:1.0:1786100492.709612:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960640896:12345-0@lo:400:kworker.0 Request processed in 31us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100492.709620:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786100492.709644:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960641024 00000100:00100000:0.0:1786100492.709648:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960641024 00000100:00100000:2.0:1786100492.709821:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960640640 00000100:00100000:2.0:1786100492.709826:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960640640 00000100:00100000:2.0:1786100492.709857:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1786100492.709865:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960640640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100492.709902:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960640640:12345-0@lo:400:kworker.0 Request processed in 37us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100492.709909:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1786100492.709955:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960640640:0@lo:400:kworker.0 00000100:00100000:0.0:1786100492.710042:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786100492.710052:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960641280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100492.710070:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1786100492.710090:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1786100492.710093:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960641280:12345-0@lo:400:kworker.0 Request processed in 43us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100492.710102:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786100492.710119:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786100492.710126:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960641024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100492.710160:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960641024:12345-0@lo:400:kworker.0 Request processed in 35us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100492.710167:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1786100492.710200:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d1500 x1872861960641024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100492.710214:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960641024:0@lo:400:kworker.0 00000100:00080000:0.0:1786100492.710248:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786100492.710253:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786100492.710256:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100492.710267:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960641152 00000100:00100000:0.0:1786100492.710271:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960641152 00000100:00100000:0.0:1786100492.710297:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786100492.710304:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960641152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100492.710337:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960641152:12345-0@lo:400:kworker.0 Request processed in 34us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100492.710343:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1786100492.710359:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100492.710384:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960640896:0@lo:400:kworker.0 00000100:00100000:0.0:1786100492.710396:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960640768:0@lo:400:kworker.0 00010000:00080000:0.0:1786100492.710416:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d1c00 x1872861960641280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100492.710426:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960641280:0@lo:400:kworker.0 00000100:00100000:2.0:1786100492.710622:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960641152:0@lo:400:kworker.0 00000100:00100000:1.0:1786100493.221513:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960641408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100493.221589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100493.221669:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960641408 00000100:00100000:0.0:1786100493.221669:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960641536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100493.221675:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960641408 00000100:00100000:0.0:1786100493.221698:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100493.221710:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960641536 00000100:00100000:1.0:1786100493.221713:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960641536 00000100:00100000:1.0:1786100493.221728:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1786100493.221736:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960641408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100493.221779:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100493.221822:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960641408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (232us total) trans 0 rc 0/0 00010000:00080000:2.0:1786100493.229941:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d2a00 x1872861960641408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100493.229967:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960641408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100493.233213:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1786100493.233246:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786100493.233261:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960641536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786100493.233298:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100493.233382:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960641536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (11683us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100493.233389:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1786100493.233474:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429ae680 x1872861960641536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100493.233496:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960641536:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1786100493.419615:0:9444:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.56.50 00010000:00010000:0.0:1786100493.482887:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100494.477333:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100494.477382:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100494.480126:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941735552 00000100:00100000:0.0:1786100494.480142:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941735552 00000100:00100000:0.0:1786100494.480217:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:0.0:1786100494.480240:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941735552:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100494.480316:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941735552:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 79us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100494.480323:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00080000:0.0:1786100494.480347:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100494.480764:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941735424 00000100:00100000:1.0:1786100494.480770:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941735424 00000100:00100000:1.0:1786100494.480811:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 198 00000100:00100000:1.0:1786100494.480819:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+10:2353:x1872861941735424:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100494.480856:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+10:2353:x1872861941735424:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 38us (3532us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100494.480863:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 198 00010000:00010000:0.0:1786100494.502628:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786100495.397683:0:9493:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Aug 7 07:01:33 EDT 2026 00010000:00010000:2.0:1786100495.526496:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100496.548829:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100497.573230:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100497.829556:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786100497.829586:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960641664:0@lo:400:kworker.0 00000100:00100000:3.0:1786100497.829685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100497.829762:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960641664 00000100:00100000:3.0:1786100497.829770:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960641664 00000100:00100000:3.0:1786100497.829821:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1786100497.829830:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960641664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100497.829890:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960641664:12345-0@lo:400:kworker.0 Request processed in 60us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100497.829899:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1786100497.831571:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960641664:0@lo:400:kworker.0 00000100:00100000:3.0:1786100497.831674:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786100497.831697:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960641792:0@lo:400:kworker.0 00000100:00100000:3.0:1786100497.831754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100497.831801:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960641792 00000100:00100000:3.0:1786100497.831808:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960641792 00000100:00100000:3.0:1786100497.831854:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786100497.831864:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960641792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100497.831916:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960641792:12345-0@lo:400:kworker.0 Request processed in 53us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100497.831923:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786100497.831954:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960641792:0@lo:400:kworker.0 00000100:00100000:3.0:1786100497.831982:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960641920:0@lo:400:kworker.0 00000100:00100000:3.0:1786100497.833442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100497.833567:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960642048:0@lo:400:kworker.0 00000100:00100000:3.0:1786100497.833611:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100497.833673:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960642048 00000100:00100000:3.0:1786100497.833681:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960642048 00000100:00100000:3.0:1786100497.833740:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786100497.833749:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960642048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100497.833801:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960642048:12345-0@lo:400:kworker.0 Request processed in 53us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100497.833809:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1786100497.833829:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786100497.833866:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b42517800 x1872861960642048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100497.833880:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960642048:0@lo:400:kworker.0 00000100:00100000:3.0:1786100497.833917:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960642176:0@lo:400:kworker.0 00000100:00100000:1.0:1786100497.834376:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960641920 00000100:00100000:1.0:1786100497.834382:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960641920 00000100:00100000:1.0:1786100497.834424:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786100497.834433:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960641920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100497.834482:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960641920:12345-0@lo:400:kworker.0 Request processed in 51us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100497.834488:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1786100497.834515:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100497.834550:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960641920:0@lo:400:kworker.0 00000100:00100000:3.0:1786100497.838516:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100497.838612:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960642176 00000100:00100000:3.0:1786100497.838621:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960642176 00000100:00100000:3.0:1786100497.838702:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1786100497.838713:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960642176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100497.838777:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960642176:12345-0@lo:400:kworker.0 Request processed in 66us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100497.838786:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1786100497.838833:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960642176:0@lo:400:kworker.0 00000100:00080000:1.0:1786100497.840402:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100497.840434:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960642304:0@lo:400:kworker.0 00000100:00100000:1.0:1786100497.840515:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100497.840576:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960642304 00000100:00100000:1.0:1786100497.840584:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960642304 00000100:00100000:1.0:1786100497.840642:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786100497.840671:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960642304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100497.840726:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960642304:12345-0@lo:400:kworker.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100497.840734:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1786100497.840752:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1786100497.840783:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b42517800 x1872861960642304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100497.840799:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960642304:0@lo:400:kworker.0 00000100:00100000:0.0:1786100498.344162:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960642432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100498.344267:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100498.344364:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960642432 00000100:00100000:0.0:1786100498.344372:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960642432 00000100:00100000:0.0:1786100498.344436:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786100498.344447:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960642432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786100498.344507:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100498.344568:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960642432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100498.344576:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1786100498.344625:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429ae300 x1872861960642432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100498.344647:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960642432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100498.347293:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786100498.347319:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960642560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100498.347414:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100498.347487:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960642560 00000100:00100000:3.0:1786100498.347511:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960642560 00000100:00100000:3.0:1786100498.347559:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786100498.347568:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960642560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786100498.347619:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100498.347682:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960642560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100498.347690:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1786100498.347731:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b42514e00 x1872861960642560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100498.347752:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960642560:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786100498.603337:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100499.591843:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100499.591889:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100499.591944:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941735808 00000100:00100000:1.0:1786100499.591958:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941735808 00000100:00100000:1.0:1786100499.592036:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:1.0:1786100499.592047:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941735808:12345-192.168.206.53@tcp:400:kworker.0 00000100:00080000:3.0:1786100499.592116:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100499.592135:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941735808:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100499.592144:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:2.0:1786100499.592439:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941735680 00000100:00100000:2.0:1786100499.592445:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941735680 00000100:00100000:2.0:1786100499.592585:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 200 00000100:00100000:2.0:1786100499.592597:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:2354:x1872861941735680:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100499.592629:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:2354:x1872861941735680:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 37us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100499.592724:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 200 00010000:00010000:0.0:1786100499.621119:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100500.646893:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100501.676379:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100502.694357:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100502.949091:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960642688:0@lo:400:kworker.0 00000100:00100000:0.0:1786100502.949205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100502.949552:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960642816:0@lo:400:kworker.0 00000100:00100000:3.0:1786100502.949593:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100502.949617:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960643328:0@lo:400:kworker.0 00000100:00100000:3.0:1786100502.949644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100502.949762:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960642816 00000100:00100000:1.0:1786100502.949772:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960642816 00000100:00100000:1.0:1786100502.949843:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1786100502.949856:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960642816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100502.949918:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960642816:12345-0@lo:400:kworker.0 Request processed in 65us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100502.949933:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1786100502.949965:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960643072:0@lo:400:kworker.0 00000100:00100000:0.0:1786100502.950411:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960643200:0@lo:400:kworker.0 00000100:00100000:0.0:1786100502.950445:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100502.950580:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960642816:0@lo:400:kworker.0 00000100:00100000:3.0:1786100502.950599:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786100502.950607:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960642944:0@lo:400:kworker.0 00000100:00100000:3.0:1786100502.950633:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100502.950767:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100502.951174:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960642688 00000100:00100000:3.0:1786100502.951182:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960642688 00000100:00100000:3.0:1786100502.951270:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1786100502.951279:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960642688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100502.951332:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960642688:12345-0@lo:400:kworker.0 Request processed in 54us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100502.951339:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1786100502.951410:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960643200 00000100:00100000:1.0:1786100502.951414:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960643200 00000100:00100000:1.0:1786100502.951453:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960642944 00000100:00100000:1.0:1786100502.951456:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960642944 00000100:00100000:1.0:1786100502.951483:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786100502.951491:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960643200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100502.951529:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960643200:12345-0@lo:400:kworker.0 Request processed in 39us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100502.951535:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786100502.951548:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1786100502.951554:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960642944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100502.951610:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960642944:12345-0@lo:400:kworker.0 Request processed in 56us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100502.951616:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1786100502.951635:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100502.951692:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960642944:0@lo:400:kworker.0 00000100:00100000:2.0:1786100502.957508:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960643328 00000100:00100000:2.0:1786100502.957529:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960643328 00000100:00100000:2.0:1786100502.962980:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960643072 00000100:00100000:2.0:1786100502.963192:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960643072 00000100:00100000:2.0:1786100502.963267:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786100502.963281:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960643328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100502.964408:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786100502.964429:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960643072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100502.964599:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960643072:12345-0@lo:400:kworker.0 Request processed in 179us (13830us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100502.964608:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1786100502.964700:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7ba2c000 x1872861960643072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100502.964742:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960643072:0@lo:400:kworker.0 00000100:00080000:1.0:1786100502.964779:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786100502.964784:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786100502.966527:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960643328:12345-0@lo:400:kworker.0 Request processed in 3247us (16878us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100502.966551:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786100502.966698:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960643200:0@lo:400:kworker.0 00000100:00100000:2.0:1786100502.966711:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960642688:0@lo:400:kworker.0 00010000:00080000:1.0:1786100502.966986:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c126300 x1872861960643328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100502.967167:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960643328:0@lo:400:kworker.0 00000100:00100000:1.0:1786100503.462265:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786100503.462295:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960643456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100503.462388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100503.462810:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786100503.462824:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960643584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786100503.462875:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100503.463777:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960643456 00000100:00100000:3.0:1786100503.463789:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960643456 00000100:00100000:3.0:1786100503.463854:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960643584 00000100:00100000:3.0:1786100503.463857:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960643584 00000100:00100000:3.0:1786100503.463877:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786100503.463887:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960643456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786100503.463936:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100503.464021:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960643456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100503.464029:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1786100503.464542:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c125500 x1872861960643456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100503.464568:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960643456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100503.464857:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786100503.464871:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960643584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786100503.464901:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100503.464925:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1786100503.464946:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1786100503.464989:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960643584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100503.464998:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1786100503.465111:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d1500 x1872861960643584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100503.465143:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960643584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786100503.727317:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100504.712597:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100504.712640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100504.712848:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941736064 00000100:00100000:3.0:1786100504.712857:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941736064 00000100:00100000:3.0:1786100504.714560:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00100000:3.0:1786100504.714575:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941736064:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100504.714663:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941736064:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 78us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100504.714670:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00080000:0.0:1786100504.715747:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100504.720966:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941735936 00000100:00100000:2.0:1786100504.720979:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941735936 00000100:00100000:0.0:1786100504.721233:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 202 00000100:00100000:0.0:1786100504.721244:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:2354:x1872861941735936:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100504.721341:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+10:2354:x1872861941735936:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 97us (8699us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100504.721348:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 202 00010000:00010000:0.0:1786100504.740887:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100505.767253:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100506.789948:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100507.817592:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100508.068876:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960643712:0@lo:400:kworker.0 00000100:00100000:1.0:1786100508.068876:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960643840:0@lo:400:kworker.0 00000100:00100000:0.0:1786100508.068951:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960644096:0@lo:400:kworker.0 00000100:00100000:2.0:1786100508.068965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100508.068990:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100508.069016:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960644224:0@lo:400:kworker.0 00000100:00100000:0.0:1786100508.069031:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960643968:0@lo:400:kworker.0 00000100:00100000:2.0:1786100508.069039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100508.069052:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100508.069069:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960644224 00000100:00100000:2.0:1786100508.069074:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960644224 00000100:00100000:0.0:1786100508.069076:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960644096 00000100:00100000:0.0:1786100508.069079:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960644096 00000100:00100000:3.0:1786100508.069121:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960643712 00000100:00100000:3.0:1786100508.069125:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960643712 00000100:00100000:3.0:1786100508.069161:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1786100508.069168:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960643712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100508.069213:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960643712:12345-0@lo:400:kworker.0 Request processed in 45us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100508.069219:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1786100508.069271:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960643712:0@lo:400:kworker.0 00000100:00100000:2.0:1786100508.069378:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960643968 00000100:00100000:2.0:1786100508.069382:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960643968 00000100:00100000:3.0:1786100508.069419:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786100508.069426:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960644224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100508.069427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100508.069472:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960644224:12345-0@lo:400:kworker.0 Request processed in 46us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100508.069478:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786100508.069490:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960643840 00000100:00100000:3.0:1786100508.069493:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960643840 00000100:00100000:3.0:1786100508.069507:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786100508.069512:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960643840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100508.070838:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786100508.070852:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960644096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100508.072949:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960644352:0@lo:400:kworker.0 00000100:00100000:1.0:1786100508.073029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100508.073226:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960644352 00000100:00100000:1.0:1786100508.073234:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960644352 00000100:00100000:2.0:1786100508.073269:0:5843:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1786100508.073271:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1786100508.073277:0:5843:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1786100508.073287:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960644352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100508.073339:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960644352:12345-0@lo:400:kworker.0 Request processed in 53us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100508.073345:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1786100508.074818:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960644224:0@lo:400:kworker.0 00000100:00100000:3.0:1786100508.075301:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960643840:12345-0@lo:400:kworker.0 Request processed in 5785us (5871us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100508.075310:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786100508.075356:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786100508.075369:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960643968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100508.075426:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960643968:12345-0@lo:400:kworker.0 Request processed in 62us (6373us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100508.075432:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1786100508.076669:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960644096:12345-0@lo:400:kworker.0 Request processed in 5804us (7660us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100508.076679:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1786100508.076712:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786100508.076717:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786100508.076720:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100508.076820:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960643968:0@lo:400:kworker.0 00000100:00100000:1.0:1786100508.077647:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960643840:0@lo:400:kworker.0 00010000:00080000:1.0:1786100508.077769:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c124700 x1872861960644352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100508.077781:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960644352:0@lo:400:kworker.0 00010000:00080000:3.0:1786100508.077887:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c126a00 x1872861960644096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100508.077898:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960644096:0@lo:400:kworker.0 00000100:00100000:3.0:1786100508.583061:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786100508.583082:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960644480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100508.583138:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100508.583196:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960644480 00000100:00100000:3.0:1786100508.583202:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960644480 00000100:00100000:3.0:1786100508.583244:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786100508.583252:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960644480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786100508.583283:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100508.583325:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960644480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100508.583331:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1786100508.583366:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c126a00 x1872861960644480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100508.583382:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960644480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100508.594828:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786100508.594849:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960644608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100508.594912:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100508.598586:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960644608 00000100:00100000:3.0:1786100508.598601:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960644608 00000100:00100000:0.0:1786100508.598836:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786100508.598857:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960644608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786100508.598894:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100508.598974:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960644608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (4061us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100508.598981:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1786100508.599097:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c126a00 x1872861960644608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100508.599115:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960644608:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786100508.847231:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100509.834207:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100509.835002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100509.835031:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941736320 00000100:00100000:3.0:1786100509.835039:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941736320 00000100:00100000:2.0:1786100509.839772:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941736192 00000100:00100000:2.0:1786100509.839787:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941736192 00000100:00100000:2.0:1786100509.839845:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 204 00000100:00100000:2.0:1786100509.839855:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+10:2352:x1872861941736192:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100509.839925:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+10:2352:x1872861941736192:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 72us (4926us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100509.839938:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 204 00000100:00100000:3.0:1786100509.840574:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:3.0:1786100509.840585:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2352:x1872861941736320:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100509.840625:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2352:x1872861941736320:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 43us (6427us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100509.840632:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00080000:0.0:1786100509.846527:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786100509.866465:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100510.885904:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100511.909018:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100512.932980:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100513.189382:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960645120:0@lo:400:kworker.0 00000100:00100000:0.0:1786100513.189402:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960644992:0@lo:400:kworker.0 00000100:00100000:2.0:1786100513.189503:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100513.189522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100513.189599:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1786100513.189609:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960644736:0@lo:400:kworker.0 00000100:00100000:2.0:1786100513.189678:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100513.189949:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960645248:0@lo:400:kworker.0 00000100:00100000:2.0:1786100513.189994:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100513.190031:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960644864:0@lo:400:kworker.0 00000100:00100000:2.0:1786100513.190058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100513.190078:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960645376:0@lo:400:kworker.0 00000100:00100000:2.0:1786100513.190102:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100513.190139:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960645120 00000100:00100000:2.0:1786100513.190149:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960645120 00000100:00100000:1.0:1786100513.191376:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960644736 00000100:00100000:1.0:1786100513.191390:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960644736 00000100:00100000:1.0:1786100513.191484:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1786100513.191496:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960644736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100513.191609:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960644736:12345-0@lo:400:kworker.0 Request processed in 115us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100513.191617:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1786100513.191682:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960645376 00000100:00100000:1.0:1786100513.191687:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960645376 00000100:00100000:3.0:1786100513.197209:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960644992 00000100:00100000:3.0:1786100513.197224:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960644992 00000100:00100000:3.0:1786100513.197276:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960645248 00000100:00100000:3.0:1786100513.197279:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960645248 00000100:00100000:3.0:1786100513.197294:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960644864 00000100:00100000:3.0:1786100513.197297:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960644864 00000100:00100000:3.0:1786100513.197314:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1786100513.197324:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960644992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100513.197673:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960644992:12345-0@lo:400:kworker.0 Request processed in 86us (7890us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100513.197683:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1786100513.197703:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786100513.197711:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960645248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100513.197744:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960645248:12345-0@lo:400:kworker.0 Request processed in 35us (7750us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100513.197750:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786100513.197775:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786100513.197782:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960644864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100513.197820:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960644864:12345-0@lo:400:kworker.0 Request processed in 39us (7761us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100513.197826:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786100513.197891:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960644864:0@lo:400:kworker.0 00000100:00080000:3.0:1786100513.197928:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786100513.197932:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786100513.197935:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786100513.197963:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960644736:0@lo:400:kworker.0 00000100:00100000:3.0:1786100513.197973:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960645248:0@lo:400:kworker.0 00000100:00100000:0.0:1786100513.198071:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960644992:0@lo:400:kworker.0 00000100:00100000:2.0:1786100513.202989:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786100513.203020:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960645120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100513.203157:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960645120:12345-0@lo:400:kworker.0 Request processed in 152us (13655us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100513.203165:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1786100513.203393:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c451e6680 x1872861960645120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100513.203425:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960645120:0@lo:400:kworker.0 00000100:00100000:1.0:1786100513.203918:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786100513.203934:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960645376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100513.204010:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960645376:12345-0@lo:400:kworker.0 Request processed in 83us (13906us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100513.204017:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1786100513.204072:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c451e6300 x1872861960645376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100513.204085:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960645376:0@lo:400:kworker.0 00000100:00100000:3.0:1786100513.701091:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960645504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100513.701185:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100513.701235:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960645504 00000100:00100000:3.0:1786100513.701244:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960645504 00000100:00100000:3.0:1786100513.701302:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786100513.701312:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960645504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786100513.701368:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100513.703791:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960645504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2467us (2593us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100513.703808:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786100513.708388:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786100513.708432:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960645632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100513.708557:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100513.708631:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960645632 00000100:00100000:1.0:1786100513.708640:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960645632 00000100:00100000:1.0:1786100513.708721:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786100513.708732:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960645632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100513.708777:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100513.708827:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960645632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100513.708835:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1786100513.708881:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7ba2ce00 x1872861960645632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100513.708904:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960645632:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1786100513.710783:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c124a80 x1872861960645504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100513.710819:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960645504:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786100513.957001:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786100514.554996:0:10128:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 07:01:51 (1786100511) === 00000100:00100000:3.0:1786100514.965452:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100514.965497:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100514.965602:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941736448 00000100:00100000:1.0:1786100514.965611:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941736448 00000100:00100000:1.0:1786100514.965692:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 206 00000100:00100000:1.0:1786100514.965701:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+10:2351:x1872861941736448:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100514.965772:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+10:2351:x1872861941736448:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 72us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100514.965779:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 206 00000100:00100000:0.0:1786100514.965914:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941736576 00000100:00100000:0.0:1786100514.965918:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941736576 00000100:00100000:0.0:1786100514.965967:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:0.0:1786100514.965974:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941736576:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100514.966005:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941736576:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100514.966011:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00080000:1.0:1786100514.966118:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786100514.980937:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100515.305981:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100515.306133:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941736704 00000100:00100000:3.0:1786100515.306142:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941736704 00000100:00100000:3.0:1786100515.306203:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 207 00000100:00100000:3.0:1786100515.306212:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+10:8139:x1872861941736704:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1786100515.306228:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100515.306245:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac0de2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2e1d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100515.306271:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac0de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e1d expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100515.306282:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac0de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e1d expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100515.306290:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98000, rc 0) 00000100:00100000:3.0:1786100515.306351:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+11:8139:x1872861941736704:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 139us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100515.306367:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 207 00000100:00100000:3.0:1786100515.312621:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100515.312819:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941736832 00000100:00100000:2.0:1786100515.312828:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941736832 00000100:00100000:2.0:1786100515.312892:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 208 00000100:00100000:2.0:1786100515.312913:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+11:8139:x1872861941736832:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786100515.313492:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+11:8139:x1872861941736832:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 578us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100515.313500:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 208 00000100:00100000:2.0:1786100515.318482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100515.318700:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941736960 00000100:00100000:1.0:1786100515.318709:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941736960 00000100:00100000:1.0:1786100515.318764:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 209 00000100:00100000:1.0:1786100515.318774:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+11:8139:x1872861941736960:12345-192.168.206.53@tcp:503:mount.lustre.0 00000100:00100000:1.0:1786100515.319002:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+11:8139:x1872861941736960:12345-192.168.206.53@tcp:503:mount.lustre.0 Request processed in 229us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100515.319010:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 209 00000100:00100000:1.0:1786100515.332122:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100515.332210:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941737088 00000100:00100000:3.0:1786100515.332219:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941737088 00000100:00100000:3.0:1786100515.332273:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 210 00000100:00100000:3.0:1786100515.332284:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+11:8141:x1872861941737088:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786100515.332579:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+11:8141:x1872861941737088:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 295us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100515.332596:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 210 00000100:00100000:3.0:1786100515.376754:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100515.376908:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941737216 00000100:00100000:2.0:1786100515.376918:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941737216 00000100:00100000:2.0:1786100515.376969:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 211 00000100:00100000:2.0:1786100515.376979:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+11:8141:x1872861941737216:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786100515.377230:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+11:8141:x1872861941737216:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 252us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100515.377238:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 211 00000100:00100000:2.0:1786100515.392334:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100515.392519:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941737344 00000100:00100000:1.0:1786100515.392528:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941737344 00000100:00100000:1.0:1786100515.392584:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 212 00000100:00100000:1.0:1786100515.392595:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+11:8139:x1872861941737344:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1786100515.392610:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100515.392627:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac0de9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2e47 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100515.392689:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac0de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e47 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100515.392701:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac0de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e47 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100515.392710:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62387600, rc 0) 00000100:00100000:1.0:1786100515.392769:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+12:8139:x1872861941737344:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 176us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100515.392776:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 212 00000100:00100000:1.0:1786100515.399725:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100515.399814:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941737472 00000100:00100000:3.0:1786100515.399824:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941737472 00000100:00100000:3.0:1786100515.399872:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 213 00000100:00100000:3.0:1786100515.399881:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+12:8139:x1872861941737472:12345-192.168.206.53@tcp:256:mount.lustre.0 20000000:01000000:3.0:1786100515.399915:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1786100515.399932:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1786100515.399936:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1786100515.399939:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1786100515.399942:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1786100515.401343:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+12:8139:x1872861941737472:12345-192.168.206.53@tcp:256:mount.lustre.0 Request processed in 1456us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100515.401356:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 213 00000100:00100000:2.0:1786100515.409568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100515.409697:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941737600 00000100:00100000:1.0:1786100515.409707:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941737600 00000100:00100000:1.0:1786100515.409759:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 214 00000100:00100000:1.0:1786100515.409769:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+12:8139:x1872861941737600:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1786100515.409784:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100515.409800:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0df0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2e4e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100515.409827:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0df0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e4e expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100515.409838:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0df0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e4e expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100515.409847:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386e00, rc 0) 00000100:00100000:1.0:1786100515.412224:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:8139:x1872861941737600:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 2445us (2653us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100515.412237:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 214 00000100:00100000:1.0:1786100515.427555:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100515.427768:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941737728 00000100:00100000:2.0:1786100515.427777:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941737728 00000100:00100000:2.0:1786100515.427830:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 215 00000100:00100000:2.0:1786100515.427839:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:8139:x1872861941737728:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786100515.429690:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:8139:x1872861941737728:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 1843us (2135us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100515.429703:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 215 00000100:00100000:2.0:1786100515.439646:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100515.439836:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941737856 00000100:00100000:1.0:1786100515.439846:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941737856 00000100:00100000:1.0:1786100515.439906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 216 00000100:00100000:1.0:1786100515.439916:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:8139:x1872861941737856:12345-192.168.206.53@tcp:503:mount.lustre.0 00000100:00100000:1.0:1786100515.440134:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:8139:x1872861941737856:12345-192.168.206.53@tcp:503:mount.lustre.0 Request processed in 218us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100515.440141:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 216 00000100:00100000:0.0:1786100515.446810:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100515.446897:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941737984 00000100:00100000:2.0:1786100515.446907:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941737984 00000100:00100000:2.0:1786100515.446972:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 217 00000100:00100000:2.0:1786100515.446982:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:8146:x1872861941737984:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786100515.447227:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:8146:x1872861941737984:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 245us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100515.447234:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 217 00000100:00100000:2.0:1786100515.462366:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100515.462705:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941738112 00000100:00100000:3.0:1786100515.462713:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941738112 00000100:00100000:3.0:1786100515.462762:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 218 00000100:00100000:3.0:1786100515.462770:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+13:8146:x1872861941738112:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786100515.463115:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+13:8146:x1872861941738112:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 344us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100515.463122:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 218 00000100:00100000:3.0:1786100515.466512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100515.467073:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941738240 00000100:00100000:2.0:1786100515.467083:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941738240 00000100:00100000:2.0:1786100515.467122:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:2.0:1786100515.467130:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1872861941738240:12345-192.168.206.53@tcp:38:mount.lustre.0 00010000:00080000:2.0:1786100515.467158:0:5844:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 3868b77e-5219-4134-824e-d85227fdc483@192.168.206.53@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:2.0:1786100515.467202:0:5844:0:(genops.c:1406:class_connect()) connect: client 3868b77e-5219-4134-824e-d85227fdc483, cookie 0x5564f2c20ac0df7 00000004:00100000:2.0:1786100515.467231:0:5844:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1786100515.480995:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9a3b41ed4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786100515.481076:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3868b77e-5219-4134-824e-d85227fdc483+6:2350:x1872861941738240:12345-192.168.206.53@tcp:38:mount.lustre.0 Request processed in 13943us (14570us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100515.481087:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:0.0:1786100515.485171:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100515.485264:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941738368 00000100:00100000:3.0:1786100515.485273:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941738368 00000100:00100000:3.0:1786100515.485349:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:3.0:1786100515.485359:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+6:0:x1872861941738368:12345-192.168.206.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1786100515.485413:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1786100515.485496:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+6:0:x1872861941738368:12345-192.168.206.53@tcp:41:mount.lustre.0 Request processed in 138us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100515.485515:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00080000:1.0:1786100515.485584:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100515.488121:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100515.488488:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941738496 00000100:00100000:3.0:1786100515.488497:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941738496 00000100:00100000:3.0:1786100515.488552:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:3.0:1786100515.488562:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+6:8139:x1872861941738496:12345-192.168.206.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1786100515.488587:0:9953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1786100515.489480:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+6:8139:x1872861941738496:12345-192.168.206.53@tcp:41:mount.lustre.0 Request processed in 91us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100515.489490:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:2.0:1786100515.495526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100515.496117:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941738624 00000100:00100000:3.0:1786100515.496127:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941738624 00000100:00100000:3.0:1786100515.496183:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:3.0:1786100515.496192:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+6:8139:x1872861941738624:12345-192.168.206.53@tcp:40:mount.lustre.0 00000100:00100000:3.0:1786100515.496271:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+6:8139:x1872861941738624:12345-192.168.206.53@tcp:40:mount.lustre.0 Request processed in 80us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100515.496279:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:2.0:1786100515.499935:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100515.500039:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941738752 00000100:00100000:1.0:1786100515.500049:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941738752 00000100:00100000:1.0:1786100515.500097:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:1.0:1786100515.500105:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1872861941738752:12345-192.168.206.53@tcp:8:mount.lustre.0 00010000:00080000:1.0:1786100515.500135:0:9414:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 3868b77e-5219-4134-824e-d85227fdc483@192.168.206.53@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:1.0:1786100515.500165:0:9414:0:(genops.c:1406:class_connect()) connect: client 3868b77e-5219-4134-824e-d85227fdc483, cookie 0x5564f2c20ac0dfe 00002000:00100000:1.0:1786100515.500175:0:9414:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3868b77e-5219-4134-824e-d85227fdc483/ffff9a3c4599a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1786100515.500196:0:9414:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1786100515.500423:0:9414:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1786100515.500449:0:9414:0:(import.c:65:import_set_state_nolock()) ffff9a3c4599b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786100515.500511:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3868b77e-5219-4134-824e-d85227fdc483+6:2350:x1872861941738752:12345-192.168.206.53@tcp:8:mount.lustre.0 Request processed in 405us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100515.500519:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:2.0:1786100515.504831:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100515.504928:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941738880 00000100:00100000:0.0:1786100515.504937:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941738880 00000100:00100000:0.0:1786100515.504986:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:0.0:1786100515.504994:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1872861941738880:12345-192.168.206.53@tcp:8:mount.lustre.0 00010000:00080000:0.0:1786100515.505025:0:6686:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 3868b77e-5219-4134-824e-d85227fdc483@192.168.206.53@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1786100515.505052:0:6686:0:(genops.c:1406:class_connect()) connect: client 3868b77e-5219-4134-824e-d85227fdc483, cookie 0x5564f2c20ac0e05 00002000:00100000:0.0:1786100515.505062:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3868b77e-5219-4134-824e-d85227fdc483/ffff9a3c745a2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786100515.505095:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786100515.505295:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786100515.505320:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9a3c745a1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786100515.505393:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3868b77e-5219-4134-824e-d85227fdc483+6:2350:x1872861941738880:12345-192.168.206.53@tcp:8:mount.lustre.0 Request processed in 398us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100515.505515:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:2.0:1786100515.507740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100515.507814:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941739008 00000100:00100000:3.0:1786100515.507822:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941739008 00000100:00100000:3.0:1786100515.507874:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:3.0:1786100515.507884:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3868b77e-5219-4134-824e-d85227fdc483+6:8139:x1872861941739008:12345-192.168.206.53@tcp:33:mount.lustre.0 00000004:00200000:3.0:1786100515.508126:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1786100515.508266:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3868b77e-5219-4134-824e-d85227fdc483+6:8139:x1872861941739008:12345-192.168.206.53@tcp:33:mount.lustre.0 Request processed in 382us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100515.508274:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00010000:00010000:0.0:1786100516.006218:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100517.032225:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786100517.369991:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3868b77e-5219-4134-824e-d85227fdc483 00010000:00010000:1.0:1786100518.052937:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100518.313911:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960645760:0@lo:400:kworker.0 00000100:00100000:1.0:1786100518.313987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100518.314037:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960646272:0@lo:400:kworker.0 00000100:00100000:1.0:1786100518.314063:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100518.314088:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786100518.314094:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960646144:0@lo:400:kworker.0 00000100:00100000:1.0:1786100518.314134:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100518.314314:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960646144 00000100:00100000:1.0:1786100518.314322:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960646144 00000100:00100000:1.0:1786100518.314376:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786100518.314401:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960646144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100518.314451:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960646144:12345-0@lo:400:kworker.0 Request processed in 53us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100518.314465:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1786100518.314484:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786100518.314511:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429ad880 x1872861960646144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100518.314524:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960646144:0@lo:400:kworker.0 00000100:00100000:0.0:1786100518.314635:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960645760 00000100:00100000:0.0:1786100518.314640:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960645760 00000100:00100000:0.0:1786100518.314708:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1786100518.314715:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960645760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100518.314753:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960645760:12345-0@lo:400:kworker.0 Request processed in 39us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100518.314760:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1786100518.314786:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960646272 00000100:00100000:0.0:1786100518.314791:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960646272 00000100:00100000:0.0:1786100518.314820:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1786100518.314826:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960646272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100518.314856:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960646272:12345-0@lo:400:kworker.0 Request processed in 30us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100518.314862:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1786100518.314878:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100518.314894:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960645760:0@lo:400:kworker.0 00000100:00100000:0.0:1786100518.314903:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960646272:0@lo:400:kworker.0 00000100:00100000:2.0:1786100518.316507:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960645888:0@lo:400:kworker.0 00000100:00100000:2.0:1786100518.316558:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100518.316590:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960646400:0@lo:400:kworker.0 00000100:00100000:2.0:1786100518.316613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100518.316666:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786100518.316672:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960646016:0@lo:400:kworker.0 00000100:00100000:2.0:1786100518.316694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100518.317236:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960645888 00000100:00100000:0.0:1786100518.317243:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960645888 00000100:00100000:0.0:1786100518.317289:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960646016 00000100:00100000:0.0:1786100518.317292:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960646016 00000100:00100000:0.0:1786100518.317323:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1786100518.317330:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960645888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100518.317377:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960645888:12345-0@lo:400:kworker.0 Request processed in 48us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100518.317405:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1786100518.317421:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786100518.317428:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960646016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100518.317457:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960646016:12345-0@lo:400:kworker.0 Request processed in 30us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100518.317463:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786100518.317481:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960646400 00000100:00100000:0.0:1786100518.317484:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960646400 00000100:00100000:0.0:1786100518.317510:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786100518.317516:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960646400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100518.317547:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960646400:12345-0@lo:400:kworker.0 Request processed in 31us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100518.317553:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786100518.317607:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960646016:0@lo:400:kworker.0 00000100:00100000:0.0:1786100518.317617:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960645888:0@lo:400:kworker.0 00010000:00080000:0.0:1786100518.317628:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7fbf8380 x1872861960646400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100518.317638:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960646400:0@lo:400:kworker.0 00000100:00080000:2.0:1786100518.318127:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786100518.318132:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100518.820951:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960646528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100518.821756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100518.821797:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960646528 00000100:00100000:1.0:1786100518.821811:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960646528 00000100:00100000:1.0:1786100518.821881:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786100518.821893:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960646528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100518.821937:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1786100518.822563:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c234a80 x1872861960646528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100518.822591:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960646528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100518.823259:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786100518.823277:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960646656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100518.824715:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100518.824830:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960646528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2937us (3074us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100518.824846:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786100518.825118:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960646656 00000100:00100000:0.0:1786100518.825145:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960646656 00000100:00100000:0.0:1786100518.825223:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786100518.825235:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960646656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786100518.825285:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100518.825375:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960646656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (666us total) trans 0 rc 0/0 00010000:00080000:3.0:1786100518.825409:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c124a80 x1872861960646656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100518.825435:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960646656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100518.825706:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1786100519.076982:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786100519.443598:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3868b77e-5219-4134-824e-d85227fdc483 00000001:00100000:1.0:1786100519.472140:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3868b77e-5219-4134-824e-d85227fdc483 00010000:00010000:2.0:1786100520.102856:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100520.590896:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100520.590936:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100520.590969:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100520.591000:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100520.591024:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100520.591050:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941739648 00000100:00100000:1.0:1786100520.591058:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941739648 00000100:00100000:1.0:1786100520.591108:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941739520 00000100:00100000:1.0:1786100520.591111:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941739520 00000100:00100000:1.0:1786100520.591132:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:1.0:1786100520.591142:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941739648:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100520.591301:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:3.0:1786100520.591312:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941739520:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100520.591346:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941739520:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 37us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100520.591353:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00080000:3.0:1786100520.591401:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786100520.591406:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786100520.591525:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941739136 00000100:00100000:2.0:1786100520.591529:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941739136 00000100:00100000:2.0:1786100520.591569:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 220 00000100:00100000:2.0:1786100520.591578:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2353:x1872861941739136:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100520.591607:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2353:x1872861941739136:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 31us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100520.591614:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 220 00000100:00100000:0.0:1786100520.592354:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941739392 00000100:00100000:0.0:1786100520.592362:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941739392 00000100:00100000:0.0:1786100520.592436:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941739264 00000100:00100000:0.0:1786100520.592440:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941739264 00000100:00100000:0.0:1786100520.592465:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:0.0:1786100520.592473:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941739392:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100520.592516:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941739392:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 43us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100520.592522:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:0.0:1786100520.592535:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 67 00000100:00100000:0.0:1786100520.592541:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941739264:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100520.592565:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941739264:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 25us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100520.592571:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 67 00000100:00100000:1.0:1786100520.592834:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941739648:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 1691us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100520.592854:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00080000:3.0:1786100520.592985:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786100521.125088:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100522.161128:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786100522.677048:0:10325:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1786100523.173100:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100523.435004:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960646784:0@lo:400:kworker.0 00000100:00100000:3.0:1786100523.435075:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100523.435121:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960647296:0@lo:400:kworker.0 00000100:00100000:3.0:1786100523.435147:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100523.435173:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786100523.435194:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960647168:0@lo:400:kworker.0 00000100:00100000:3.0:1786100523.435220:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100523.435247:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960647040:0@lo:400:kworker.0 00000100:00100000:3.0:1786100523.435272:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100523.435289:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786100523.435294:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960646912:0@lo:400:kworker.0 00000100:00100000:3.0:1786100523.435321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100523.435338:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960647424:0@lo:400:kworker.0 00000100:00100000:3.0:1786100523.435373:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100523.435401:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960647168 00000100:00100000:3.0:1786100523.435407:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960647168 00000100:00100000:3.0:1786100523.435451:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960647424 00000100:00100000:3.0:1786100523.435454:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960647424 00000100:00100000:3.0:1786100523.435481:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786100523.435490:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960647168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100523.435537:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960647168:12345-0@lo:400:kworker.0 Request processed in 47us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100523.435544:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786100523.435560:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786100523.435566:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960647424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100523.435599:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960647424:12345-0@lo:400:kworker.0 Request processed in 33us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100523.435605:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1786100523.435621:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786100523.435625:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786100523.435682:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c235500 x1872861960647424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100523.435870:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960646784 00000100:00100000:1.0:1786100523.435874:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960646784 00000100:00100000:1.0:1786100523.435904:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1786100523.435910:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960646784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100523.435944:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960646784:12345-0@lo:400:kworker.0 Request processed in 34us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100523.435949:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00080000:1.0:1786100523.436070:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c234e00 x1872861960647168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100523.436083:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960647168:0@lo:400:kworker.0 00000100:00100000:1.0:1786100523.436094:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960646784:0@lo:400:kworker.0 00000100:00100000:3.0:1786100523.436168:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960647424:0@lo:400:kworker.0 00000100:00100000:0.0:1786100523.438306:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960647296 00000100:00100000:0.0:1786100523.438319:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960647296 00000100:00100000:0.0:1786100523.438388:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960647040 00000100:00100000:0.0:1786100523.438392:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960647040 00000100:00100000:0.0:1786100523.438418:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960646912 00000100:00100000:0.0:1786100523.438421:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960646912 00000100:00100000:0.0:1786100523.438438:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786100523.438457:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960647296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100523.438537:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960647296:12345-0@lo:400:kworker.0 Request processed in 91us (3388us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100523.438544:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786100523.438560:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1786100523.438566:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960647040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100523.438600:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960647040:12345-0@lo:400:kworker.0 Request processed in 35us (3327us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100523.438606:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1786100523.438618:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786100523.438624:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960646912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100523.438672:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960646912:12345-0@lo:400:kworker.0 Request processed in 49us (3350us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100523.438678:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1786100523.438859:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100523.438922:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960647296:0@lo:400:kworker.0 00000100:00100000:0.0:1786100523.438955:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960646912:0@lo:400:kworker.0 00000100:00100000:0.0:1786100523.438965:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960647040:0@lo:400:kworker.0 00000100:00100000:0.0:1786100523.941877:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960647552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100523.941953:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100523.942032:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786100523.942040:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960647680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100523.942073:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100523.942105:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960647552 00000100:00100000:0.0:1786100523.942126:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960647552 00000100:00100000:0.0:1786100523.942169:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960647680 00000100:00100000:0.0:1786100523.942172:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960647680 00000100:00100000:0.0:1786100523.942188:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786100523.942196:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960647552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786100523.942243:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100523.942286:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960647552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100523.942293:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786100523.942310:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1786100523.942317:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960647680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786100523.942335:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100523.942383:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960647680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100523.942389:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1786100523.942427:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7fbf8380 x1872861960647680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100523.942445:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960647680:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1786100523.942470:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c125500 x1872861960647552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100523.942481:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960647552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786100524.197443:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100525.220835:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100525.715769:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100525.715822:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100525.715853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100525.715887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100525.715923:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100525.715952:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941740160 00000100:00100000:2.0:1786100525.715961:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941740160 00000100:00100000:2.0:1786100525.716009:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941740288 00000100:00100000:2.0:1786100525.716013:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941740288 00000100:00100000:2.0:1786100525.716033:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:2.0:1786100525.716044:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bf57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941740160:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100525.716107:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bf57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941740160:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 66us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100525.716114:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:2.0:1786100525.716274:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:2.0:1786100525.716282:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941740288:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100525.716310:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941740288:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 28us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100525.716316:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00080000:2.0:1786100525.716332:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786100525.716449:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941739776 00000100:00100000:1.0:1786100525.716453:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941739776 00000100:00100000:1.0:1786100525.716483:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 222 00000100:00100000:1.0:1786100525.716490:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941739776:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100525.716519:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941739776:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 30us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100525.716525:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 222 00000100:00080000:2.0:1786100525.716647:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786100525.716907:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941739904 00000100:00100000:0.0:1786100525.716912:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941739904 00000100:00100000:0.0:1786100525.716969:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941740032 00000100:00100000:0.0:1786100525.716973:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941740032 00000100:00100000:0.0:1786100525.717000:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:0.0:1786100525.717007:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941739904:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100525.717037:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941739904:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 32us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100525.717043:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:0.0:1786100525.717056:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00100000:0.0:1786100525.717061:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941740032:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100525.717081:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941740032:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 20us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100525.717087:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00080000:2.0:1786100525.718479:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786100526.251466:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100527.268852:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100528.292916:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100528.549067:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960647808:0@lo:400:kworker.0 00000100:00100000:0.0:1786100528.549137:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100528.549191:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960648320:0@lo:400:kworker.0 00000100:00100000:0.0:1786100528.549216:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100528.549243:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786100528.549248:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960648192:0@lo:400:kworker.0 00000100:00100000:0.0:1786100528.549271:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100528.549294:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960648064:0@lo:400:kworker.0 00000100:00100000:0.0:1786100528.549315:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100528.549413:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960647808 00000100:00100000:2.0:1786100528.549420:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960647808 00000100:00100000:2.0:1786100528.549457:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1786100528.549465:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960647808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100528.549528:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960647808:12345-0@lo:400:kworker.0 Request processed in 63us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100528.549535:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1786100528.549563:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960648192 00000100:00100000:2.0:1786100528.549566:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960648192 00000100:00100000:2.0:1786100528.549598:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786100528.549604:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960648192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100528.549633:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960648192:12345-0@lo:400:kworker.0 Request processed in 29us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100528.549638:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1786100528.549684:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786100528.549727:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c451e6a00 x1872861960648192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100528.549741:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960648192:0@lo:400:kworker.0 00000100:00100000:2.0:1786100528.549766:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960647808:0@lo:400:kworker.0 00000100:00100000:0.0:1786100528.549847:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786100528.549854:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960647936:0@lo:400:kworker.0 00000100:00100000:0.0:1786100528.549875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100528.552746:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960648448:0@lo:400:kworker.0 00000100:00100000:0.0:1786100528.552821:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100528.552862:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960648448 00000100:00100000:0.0:1786100528.552868:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960648448 00000100:00100000:0.0:1786100528.552923:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786100528.552933:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960648448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100528.552984:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960648448:12345-0@lo:400:kworker.0 Request processed in 53us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100528.552991:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1786100528.553013:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1786100528.553039:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c451e7800 x1872861960648448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100528.553053:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960648448:0@lo:400:kworker.0 00000100:00100000:2.0:1786100528.558492:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960648320 00000100:00100000:2.0:1786100528.558505:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960648320 00000100:00100000:2.0:1786100528.558585:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960648064 00000100:00100000:2.0:1786100528.558588:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960648064 00000100:00100000:2.0:1786100528.558605:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960647936 00000100:00100000:2.0:1786100528.558607:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960647936 00000100:00100000:2.0:1786100528.558623:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1786100528.558633:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960648320:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1786100528.558960:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100528.558997:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1786100528.559007:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960648064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100528.559057:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960648064:12345-0@lo:400:kworker.0 Request processed in 51us (9739us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100528.559063:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1786100528.559080:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786100528.559087:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960647936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100528.559115:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960647936:12345-0@lo:400:kworker.0 Request processed in 29us (9238us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100528.559120:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786100528.559160:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960647936:0@lo:400:kworker.0 00000100:00100000:0.0:1786100528.559172:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960648064:0@lo:400:kworker.0 00000100:00100000:2.0:1786100528.559272:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960648320:12345-0@lo:400:kworker.0 Request processed in 639us (10054us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100528.559278:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786100528.560903:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960648320:0@lo:400:kworker.0 00000100:00100000:2.0:1786100529.061093:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786100529.061116:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960648576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786100529.061184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100529.061357:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960648576 00000100:00100000:3.0:1786100529.061365:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960648576 00000100:00100000:3.0:1786100529.061428:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1786100529.061439:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960648576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786100529.061472:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100529.061723:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960648576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 286us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100529.061731:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1786100529.061815:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c126300 x1872861960648576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100529.061833:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960648576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786100529.062162:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786100529.062174:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960648704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786100529.062207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100529.062292:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960648704 00000100:00100000:0.0:1786100529.062297:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960648704 00000100:00100000:0.0:1786100529.062343:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786100529.062352:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960648704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786100529.062374:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100529.062519:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960648704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100529.062526:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1786100529.065701:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7fbf8e00 x1872861960648704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100529.065728:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960648704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786100529.317005:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100530.342012:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100530.824777:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100530.824810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100530.824857:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100530.824874:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941740800 00000100:00100000:0.0:1786100530.824876:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100530.824893:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941740800 00000100:00100000:0.0:1786100530.824901:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100530.824920:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941740544 00000100:00100000:0.0:1786100530.824924:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941740544 00000100:00100000:2.0:1786100530.824943:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941740928 00000100:00100000:2.0:1786100530.824945:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941740928 00000100:00100000:0.0:1786100530.824946:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941740672 00000100:00100000:0.0:1786100530.824948:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941740672 00000100:00100000:2.0:1786100530.824965:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:0.0:1786100530.824965:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:2.0:1786100530.824974:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941740800:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100530.824974:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941740544:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100530.825043:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941740800:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 70us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100530.825051:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:2.0:1786100530.825067:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:2.0:1786100530.825074:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941740928:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100530.825258:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00100000:1.0:1786100530.825269:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941740672:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100530.825328:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941740544:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 354us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100530.825335:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00080000:0.0:1786100530.825357:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786100530.825361:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786100530.825370:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786100530.826963:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941740928:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 1881us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100530.826974:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:0.0:1786100530.827784:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941740416 00000100:00100000:0.0:1786100530.827794:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941740416 00000100:00100000:0.0:1786100530.827840:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 224 00000100:00100000:0.0:1786100530.827848:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+13:2353:x1872861941740416:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100530.827892:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+13:2353:x1872861941740416:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 45us (3035us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100530.827898:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 224 00000100:00100000:1.0:1786100530.834391:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941740672:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 8376us (8763us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100530.834408:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 77 00010000:00010000:0.0:1786100531.366946:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100532.388938:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100533.412828:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100533.669028:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960649088:0@lo:400:kworker.0 00000100:00100000:3.0:1786100533.669095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100533.669159:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786100533.669165:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960648960:0@lo:400:kworker.0 00000100:00100000:3.0:1786100533.669187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100533.669206:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960649472:0@lo:400:kworker.0 00000100:00100000:3.0:1786100533.669230:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100533.669264:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960649088 00000100:00100000:3.0:1786100533.669271:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960649088 00000100:00100000:1.0:1786100533.669494:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960649472 00000100:00100000:1.0:1786100533.669498:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960649472 00000100:00100000:1.0:1786100533.669541:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786100533.669551:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960649472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100533.669605:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960649472:12345-0@lo:400:kworker.0 Request processed in 55us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100533.669611:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786100533.669631:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960648960 00000100:00100000:1.0:1786100533.669635:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960648960 00000100:00100000:1.0:1786100533.669683:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786100533.669690:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960648960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100533.669723:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960648960:12345-0@lo:400:kworker.0 Request processed in 33us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100533.669729:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1786100533.669756:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786100533.669760:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100533.669790:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960648960:0@lo:400:kworker.0 00010000:00080000:1.0:1786100533.669803:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c125500 x1872861960649472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100533.669812:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960649472:0@lo:400:kworker.0 00000100:00100000:3.0:1786100533.669920:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1786100533.669928:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960649088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100533.669964:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960649088:12345-0@lo:400:kworker.0 Request processed in 38us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100533.669971:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1786100533.670054:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960648832:0@lo:400:kworker.0 00000100:00100000:2.0:1786100533.670097:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100533.670132:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960649344:0@lo:400:kworker.0 00000100:00100000:2.0:1786100533.670156:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100533.670175:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786100533.670181:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960649216:0@lo:400:kworker.0 00000100:00100000:2.0:1786100533.670203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100533.670225:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960649344 00000100:00100000:2.0:1786100533.670228:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960649344 00000100:00100000:2.0:1786100533.670258:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1786100533.670264:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960649344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100533.670442:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960649344:12345-0@lo:400:kworker.0 Request processed in 177us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100533.670456:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1786100533.670486:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960649344:0@lo:400:kworker.0 00000100:00100000:3.0:1786100533.670556:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960648832 00000100:00100000:3.0:1786100533.670565:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960648832 00000100:00100000:3.0:1786100533.670599:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1786100533.670605:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960648832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100533.670638:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960648832:12345-0@lo:400:kworker.0 Request processed in 33us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100533.670644:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:1.0:1786100533.670731:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100533.670750:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960649088:0@lo:400:kworker.0 00000100:00100000:2.0:1786100533.670818:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960648832:0@lo:400:kworker.0 00000100:00100000:0.0:1786100533.671187:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960649216 00000100:00100000:0.0:1786100533.671191:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960649216 00000100:00100000:0.0:1786100533.671236:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1786100533.671244:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960649216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100533.671343:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960649216:12345-0@lo:400:kworker.0 Request processed in 100us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100533.671350:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1786100533.672097:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786100533.684165:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c124700 x1872861960649216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100533.684185:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960649216:0@lo:400:kworker.0 00000100:00100000:2.0:1786100534.180884:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786100534.180904:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960649600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786100534.180963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100534.181017:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960649600 00000100:00100000:2.0:1786100534.181025:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960649600 00000100:00100000:2.0:1786100534.181065:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1786100534.181074:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960649600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786100534.181104:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100534.181148:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960649600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100534.181155:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1786100534.181190:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c451e6d80 x1872861960649600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100534.181207:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960649600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100534.182161:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786100534.182175:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960649728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100534.182219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100534.182264:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960649728 00000100:00100000:0.0:1786100534.182269:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960649728 00000100:00100000:0.0:1786100534.182311:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786100534.182323:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960649728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786100534.182346:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100534.182387:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960649728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100534.182399:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1786100534.182429:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7fbf9880 x1872861960649728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100534.182447:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960649728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786100534.440577:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100535.461177:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100535.950639:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100535.950832:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941741440 00000100:00100000:1.0:1786100535.950846:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941741440 00000100:00100000:1.0:1786100535.950954:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:1.0:1786100535.950968:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2350:x1872861941741440:12345-192.168.206.53@tcp:9:kworker.0 00000020:00000080:1.0:1786100535.951008:0:9414:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0dfe 00000100:00080000:1.0:1786100535.951029:0:9414:0:(import.c:65:import_set_state_nolock()) ffff9a3c4599b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786100535.951084:0:9414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1786100535.951518:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3868b77e-5219-4134-824e-d85227fdc483+2:2350:x1872861941741440:12345-192.168.206.53@tcp:9:kworker.0 Request processed in 551us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100535.951528:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00080000:2.0:1786100535.951683:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786100535.951900:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100535.951959:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100535.952116:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100535.952144:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941741568 00000100:00100000:3.0:1786100535.952151:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941741568 00000100:00100000:3.0:1786100535.952201:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:3.0:1786100535.952212:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3868b77e-5219-4134-824e-d85227fdc483+5:2350:x1872861941741568:12345-192.168.206.53@tcp:9:kworker.0 00000020:00000080:3.0:1786100535.952237:0:6684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0e05 00000100:00080000:3.0:1786100535.952295:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9a3c745a1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786100535.952330:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1786100535.952643:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3868b77e-5219-4134-824e-d85227fdc483+2:2350:x1872861941741568:12345-192.168.206.53@tcp:9:kworker.0 Request processed in 433us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100535.952692:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00010000:00010000:3.0:1786100535.952717:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786100535.952726:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786100535.953124:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941741056 00000100:00100000:1.0:1786100535.953133:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941741056 00000100:00100000:1.0:1786100535.953173:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 226 00000100:00100000:1.0:1786100535.953181:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941741056:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100535.953263:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941741056:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 82us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100535.953270:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 226 00000100:00100000:1.0:1786100535.955789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100535.955927:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100535.956067:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941741312 00000100:00100000:2.0:1786100535.956077:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941741312 00000100:00100000:2.0:1786100535.956152:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941741184 00000100:00100000:2.0:1786100535.956156:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941741184 00000100:00100000:2.0:1786100535.956187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:2.0:1786100535.956200:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941741312:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100535.956209:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 82 00000100:00100000:3.0:1786100535.956224:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941741184:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100535.956306:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941741184:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 85us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100535.956315:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 82 00000100:00080000:1.0:1786100535.956337:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100535.956611:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941741312:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 412us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100535.956626:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 81 00010000:00010000:0.0:1786100536.486205:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100537.508833:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786100537.850434:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3868b77e-5219-4134-824e-d85227fdc483 00000020:00000080:3.0:1786100537.850448:0:6708:0:(genops.c:906:class_export_put()) final put ffff9a3c4599a000/3868b77e-5219-4134-824e-d85227fdc483 00000020:00000080:3.0:1786100537.850493:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c4599a000/3868b77e-5219-4134-824e-d85227fdc483 for lustre-OST0000 00000020:00000080:3.0:1786100537.856839:0:467:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c4599b000 for lustre-OST0000 00010000:00010000:0.0:1786100538.534301:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100538.789243:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960649984:0@lo:400:kworker.0 00000100:00100000:3.0:1786100538.789336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100538.789385:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960650496:0@lo:400:kworker.0 00000100:00100000:3.0:1786100538.789410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100538.789438:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786100538.789444:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960650112:0@lo:400:kworker.0 00000100:00100000:3.0:1786100538.789465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100538.789495:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960649984 00000100:00100000:3.0:1786100538.789502:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960649984 00000100:00100000:3.0:1786100538.789540:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960650112 00000100:00100000:3.0:1786100538.789544:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960650112 00000100:00100000:3.0:1786100538.789574:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1786100538.789584:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960649984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100538.789633:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960649984:12345-0@lo:400:kworker.0 Request processed in 51us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100538.789640:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1786100538.789677:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1786100538.789684:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960650112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100538.789719:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960650112:12345-0@lo:400:kworker.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100538.789726:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1786100538.789768:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960650112:0@lo:400:kworker.0 00000100:00100000:3.0:1786100538.789779:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960649984:0@lo:400:kworker.0 00000100:00100000:1.0:1786100538.789864:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960649856:0@lo:400:kworker.0 00000100:00100000:1.0:1786100538.789896:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100538.789934:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960650368:0@lo:400:kworker.0 00000100:00100000:1.0:1786100538.789958:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100538.789978:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786100538.789984:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960650240:0@lo:400:kworker.0 00000100:00100000:1.0:1786100538.790006:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100538.790036:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960650368 00000100:00100000:1.0:1786100538.790039:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960650368 00000100:00100000:1.0:1786100538.790067:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1786100538.790074:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960650368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100538.790109:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960650368:12345-0@lo:400:kworker.0 Request processed in 35us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100538.790115:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1786100538.790132:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960650496 00000100:00100000:1.0:1786100538.790135:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960650496 00000100:00100000:1.0:1786100538.790159:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960650240 00000100:00100000:1.0:1786100538.790162:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960650240 00000100:00100000:1.0:1786100538.790184:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1786100538.790191:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960650496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100538.790226:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960650496:12345-0@lo:400:kworker.0 Request processed in 36us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100538.790233:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1786100538.790245:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1786100538.790260:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960650240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100538.790298:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960650240:12345-0@lo:400:kworker.0 Request processed in 47us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100538.790303:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1786100538.790318:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786100538.790328:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786100538.790330:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786100538.790363:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c44764000 x1872861960650240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100538.790375:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960650240:0@lo:400:kworker.0 00000100:00100000:1.0:1786100538.790385:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960650368:0@lo:400:kworker.0 00010000:00080000:1.0:1786100538.790410:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c44766a00 x1872861960650496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100538.790418:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960650496:0@lo:400:kworker.0 00000100:00100000:3.0:1786100538.791579:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960649856 00000100:00100000:3.0:1786100538.791588:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960649856 00000100:00100000:3.0:1786100538.791627:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1786100538.791635:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960649856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100538.791707:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960649856:12345-0@lo:400:kworker.0 Request processed in 73us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100538.791714:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1786100538.791762:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960649856:0@lo:400:kworker.0 00000100:00100000:3.0:1786100539.300947:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960650624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100539.301016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100539.301129:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960650624 00000100:00100000:3.0:1786100539.301137:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960650624 00000100:00100000:3.0:1786100539.301199:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1786100539.301211:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960650624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786100539.301267:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100539.301320:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960650624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100539.301328:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1786100539.301398:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c44764a80 x1872861960650624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100539.301427:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960650624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100539.304429:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960650752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100539.304492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100539.304614:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960650752 00000100:00100000:0.0:1786100539.304621:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960650752 00000100:00100000:0.0:1786100539.304692:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786100539.304702:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960650752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786100539.304734:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100539.304816:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960650752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100539.304824:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1786100539.304974:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7fbfbb80 x1872861960650752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100539.304992:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960650752:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786100539.557308:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786100539.905092:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3868b77e-5219-4134-824e-d85227fdc483 00000020:00000080:2.0:1786100539.905101:0:7635:0:(genops.c:906:class_export_put()) final put ffff9a3c745a2800/3868b77e-5219-4134-824e-d85227fdc483 00000020:00000080:2.0:1786100539.905125:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c745a2800/3868b77e-5219-4134-824e-d85227fdc483 for lustre-OST0001 00000020:00000080:2.0:1786100539.905161:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c745a1800 for lustre-OST0001 00010000:00010000:3.0:1786100540.582741:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786100540.644297:0:11028:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1786100541.064319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100541.064377:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100541.064592:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941741696 00000100:00100000:1.0:1786100541.064601:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941741696 00000100:00100000:1.0:1786100541.064676:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 228 00000100:00100000:1.0:1786100541.064686:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941741696:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100541.064769:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941741696:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 84us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100541.064777:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 228 00000100:00100000:0.0:1786100541.064969:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941741824 00000100:00100000:0.0:1786100541.064973:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941741824 00000100:00100000:0.0:1786100541.065028:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 86 00000100:00100000:0.0:1786100541.065036:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941741824:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100541.065074:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941741824:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 39us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100541.065080:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 86 00000100:00080000:1.0:1786100541.065216:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100541.073417:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100541.073861:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941741952 00000100:00100000:1.0:1786100541.073871:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941741952 00000100:00100000:1.0:1786100541.073956:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 87 00000100:00100000:1.0:1786100541.073967:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941741952:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100541.074046:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941741952:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 81us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100541.074054:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 87 00000100:00080000:2.0:1786100541.074124:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786100541.604891:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100542.629620:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100543.652855:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100543.913222:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960650880:0@lo:400:kworker.0 00000100:00100000:3.0:1786100543.913316:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100543.913368:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960651392:0@lo:400:kworker.0 00000100:00100000:3.0:1786100543.913396:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100543.913427:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786100543.913434:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960651264:0@lo:400:kworker.0 00000100:00100000:3.0:1786100543.913458:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100543.913496:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960651136:0@lo:400:kworker.0 00000100:00100000:3.0:1786100543.913520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100543.913578:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786100543.913587:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960651008:0@lo:400:kworker.0 00000100:00100000:3.0:1786100543.913611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100543.913643:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960651520:0@lo:400:kworker.0 00000100:00100000:3.0:1786100543.913687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100543.913716:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960650880 00000100:00100000:3.0:1786100543.913722:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960650880 00000100:00100000:3.0:1786100543.913764:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1786100543.913773:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960650880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100543.913821:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960650880:12345-0@lo:400:kworker.0 Request processed in 49us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100543.913827:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1786100543.913866:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960650880:0@lo:400:kworker.0 00000100:00100000:2.0:1786100543.914053:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960651392 00000100:00100000:2.0:1786100543.914058:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960651392 00000100:00100000:2.0:1786100543.914114:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960651136 00000100:00100000:2.0:1786100543.914118:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960651136 00000100:00100000:2.0:1786100543.914131:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960651008 00000100:00100000:2.0:1786100543.914133:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960651008 00000100:00100000:2.0:1786100543.914144:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786100543.914151:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960651392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100543.914191:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960651392:12345-0@lo:400:kworker.0 Request processed in 40us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100543.914197:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786100543.914209:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1786100543.914215:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960651136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100543.914262:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960651136:12345-0@lo:400:kworker.0 Request processed in 47us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100543.914268:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1786100543.914280:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1786100543.914286:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960651008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100543.914311:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960651008:12345-0@lo:400:kworker.0 Request processed in 25us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100543.914324:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1786100543.914356:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960651008:0@lo:400:kworker.0 00000100:00100000:2.0:1786100543.914365:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960651136:0@lo:400:kworker.0 00000100:00100000:2.0:1786100543.914387:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960651392:0@lo:400:kworker.0 00000100:00100000:1.0:1786100543.914578:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960651264 00000100:00100000:1.0:1786100543.914588:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960651264 00000100:00100000:1.0:1786100543.914755:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960651520 00000100:00100000:1.0:1786100543.914760:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960651520 00000100:00100000:1.0:1786100543.914783:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786100543.914791:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960651264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100543.914831:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960651264:12345-0@lo:400:kworker.0 Request processed in 41us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100543.914837:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786100543.914848:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1786100543.914855:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960651520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100543.914885:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960651520:12345-0@lo:400:kworker.0 Request processed in 32us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100543.914891:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1786100543.915413:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786100543.915418:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786100543.915421:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1786100543.915450:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d1c00 x1872861960651520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100543.915464:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960651520:0@lo:400:kworker.0 00010000:00080000:2.0:1786100543.915496:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d0380 x1872861960651264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100543.915505:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960651264:0@lo:400:kworker.0 00000020:00000080:0.0:1786100544.270466:0:11176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec0e865d0 20000000:00000080:0.0:1786100544.270482:0:11176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a3c473d7400 uarg=0000000000000000 20000000:01000000:0.0:1786100544.270515:0:11176:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1786100544.270520:0:11176:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1786100544.270524:0:11176:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1786100544.271329:0:11177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1786100544.271474:0:11176:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1786100544.289303:0:11176:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1786100544.291136:0:11176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100544.291161:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4fbbb800/0x5564f2c20ac0db1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e16 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100544.291169:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c62386600/0x5564f2c20ac0dbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0db8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100544.291176:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0dcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0dc6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100544.291181:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0ddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0dd4 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100544.291203:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0df0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e4e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100544.291211:0:11176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100544.291269:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0df0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e4e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100544.291285:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0df0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e4e expref: 12 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100544.291301:0:11176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1872861960651648:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100544.291413:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0ddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0dd4 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100544.291422:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0ddb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0dd4 expref: 18 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100544.291433:0:11176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1872861960651776:0@lo:104: 00000100:00100000:2.0:1786100544.291473:0:11176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786100544.291518:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0dc6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100544.291526:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0dcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0dc6 expref: 18 pid: 5838 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100544.291534:0:11176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1872861960651904:0@lo:104: 00000100:00100000:2.0:1786100544.291565:0:11176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786100544.291590:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c62386600/0x5564f2c20ac0dbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0db8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100544.291598:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c62386600/0x5564f2c20ac0dbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0db8 expref: 18 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100544.291606:0:11176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1872861960652032:0@lo:104: 00000100:00100000:2.0:1786100544.291627:0:11176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786100544.291686:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4fbbb800/0x5564f2c20ac0db1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e16 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100544.291695:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c4fbbb800/0x5564f2c20ac0db1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e16 expref: 12 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100544.291704:0:11176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1872861960652160:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100544.291753:0:11176:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4728de40 going to sleep for 11 seconds 00000100:00100000:0.0:1786100544.292301:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960651776 00000100:00100000:0.0:1786100544.292309:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960651776 00000100:00100000:0.0:1786100544.292343:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960651904 00000100:00100000:0.0:1786100544.292346:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960651904 00000100:00100000:0.0:1786100544.292356:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960652032 00000100:00100000:0.0:1786100544.292359:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960652032 00000100:00100000:0.0:1786100544.292371:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786100544.292379:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:11176:x1872861960651776:12345-0@lo:104: 00010000:00010000:0.0:1786100544.292390:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0ddb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292450:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786100544.292455:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+5:11176:x1872861960651776:12345-0@lo:104: Request processed in 77us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100544.292462:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786100544.292476:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786100544.292481:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:11176:x1872861960651904:12345-0@lo:104: 00010000:00010000:0.0:1786100544.292488:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0dcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292516:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1786100544.292520:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:11176:x1872861960651904:12345-0@lo:104: Request processed in 39us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100544.292534:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786100544.292545:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786100544.292551:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:11176:x1872861960652032:12345-0@lo:104: 00010000:00010000:0.0:1786100544.292559:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0dbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292594:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1786100544.292598:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:11176:x1872861960652032:12345-0@lo:104: Request processed in 48us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100544.292604:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1786100544.292639:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786100544.292644:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0ddb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292671:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbac00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100544.292675:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0ddb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292683:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0ddb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100544.292690:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0ddb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100544.292695:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786100544.292723:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ddb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292729:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100544.292757:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ddb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292765:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac0dd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0ddb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292777:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786100544.292780:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0dcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292786:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387c00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100544.292789:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0dcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292796:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0dcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100544.292801:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0dcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100544.292807:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786100544.292822:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0dcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292828:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100544.292843:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0dcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292849:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c62387c00/0x5564f2c20ac0dc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0dcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292858:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100544.292867:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0dbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292872:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb000 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100544.292875:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0dbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292882:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0dbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100544.292888:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0dbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100544.292893:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786100544.292906:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0dbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292911:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100544.292918:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0dbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292923:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac0db8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0dbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.292935:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100544.292937:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100544.292938:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100544.292945:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100544.292949:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100544.292959:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960652288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786100544.292992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100544.293034:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960652416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786100544.293057:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100544.293884:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786100544.293896:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960652544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786100544.293930:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100544.294063:0:11176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1872861960651776:0@lo:104: 00000100:00100000:2.0:1786100544.294073:0:11176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1872861960651904:0@lo:104: 00000100:00100000:2.0:1786100544.294081:0:11176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1872861960652032:0@lo:104: 00000100:00100000:3.0:1786100544.296942:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960652288 00000100:00100000:3.0:1786100544.296956:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960652288 00010000:00010000:3.0:1786100544.297004:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0ddb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0dd4 expref: 19 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100544.297031:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960652416 00000100:00100000:3.0:1786100544.297035:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960652416 00010000:00010000:3.0:1786100544.297052:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0dcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0dc6 expref: 20 pid: 5838 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100544.297063:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960652544 00000100:00100000:3.0:1786100544.297065:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960652544 00010000:00010000:3.0:1786100544.297074:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c62386600/0x5564f2c20ac0dbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0db8 expref: 21 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100544.297086:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786100544.297094:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d75850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+21:3306:x1872861960652288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786100544.297121:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100544.297126:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0ddb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0dd4 expref: 21 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.297135:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0ddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0dd4 expref: 21 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.297151:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c41511200/0x5564f2c20ac0ddb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0dd4 expref: 21 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.297165:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100544.298691:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1786100544.298702:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1786100544.298745:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960652288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786100544.298854:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786100544.298865:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+20:3307:x1872861960652416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786100544.298878:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100544.298885:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0dcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0dc6 expref: 20 pid: 5838 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.298896:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0dc6 expref: 20 pid: 5838 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.298909:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c41511000/0x5564f2c20ac0dcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0dc6 expref: 20 pid: 5838 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100544.298919:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100544.301775:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100544.301801:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100544.301853:0:11176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1872861960651648:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100544.301866:0:11176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1872861960652160:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100544.301901:0:11176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100544.302005:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1786100544.302017:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941742080 00000100:00100000:1.0:1786100544.302022:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941742080 00010000:00010000:1.0:1786100544.302051:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0df0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e4e expref: 13 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100544.302071:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1786100544.302075:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941742208 00000100:00100000:1.0:1786100544.302078:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941742208 00010000:00010000:1.0:1786100544.302101:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4fbbb800/0x5564f2c20ac0db1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e16 expref: 14 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100544.302409:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d75850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3306:x1872861960652288:12345-0@lo:103:ldlm_bl.0 Request processed in 5313us (9413us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100544.302417:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786100544.302465:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1786100544.302471:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786100544.302479:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:3307:x1872861960652544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786100544.302490:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100544.302496:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c62386600/0x5564f2c20ac0dbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0db8 expref: 18 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302506:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c62386600/0x5564f2c20ac0dbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0db8 expref: 18 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302522:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62386600/0x5564f2c20ac0dbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0db8 expref: 18 pid: 5837 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302535:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100544.302626:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:3307:x1872861960652544:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (8695us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100544.302644:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786100544.302682:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1786100544.302691:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:3.0:1786100544.302697:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d69173c-d092-48de-a520-1459f9171aec+14:2351:x1872861941742080:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100544.302705:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100544.302709:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0df0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e4e expref: 14 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302718:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0df0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e4e expref: 14 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302728:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0df0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e4e expref: 14 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302736:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100544.302774:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941742080:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 76us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100544.302780:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:3.0:1786100544.302791:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1786100544.302796:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:3.0:1786100544.302802:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d69173c-d092-48de-a520-1459f9171aec+12:2351:x1872861941742208:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100544.302809:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100544.302813:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4fbbb800/0x5564f2c20ac0db1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e16 expref: 12 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302821:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4fbbb800/0x5564f2c20ac0db1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e16 expref: 12 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302844:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbbb800/0x5564f2c20ac0db1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e16 expref: 12 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302855:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302861:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302873:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302880:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302887:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302893:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302900:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100544.302903:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302910:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302925:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.302944:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100544.302965:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d69173c-d092-48de-a520-1459f9171aec+11:2351:x1872861941742208:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 163us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100544.302972:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:0.0:1786100544.305400:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:3307:x1872861960652416:12345-0@lo:103:ldlm_bl.0 Request processed in 6530us (12333us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100544.305412:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1786100544.306385:0:11176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.306399:0:11176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100544.306406:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0a600/0x5564f2c20ac0e0c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100544.306434:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960652544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786100544.306460:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960652416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786100544.422202:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960652672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100544.422276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100544.422371:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960652672 00000100:00100000:3.0:1786100544.422378:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960652672 00000100:00100000:3.0:1786100544.422543:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786100544.422553:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960652672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786100544.422584:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100544.422627:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960652672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100544.422635:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786100544.426727:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960652800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100544.426788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1786100544.426863:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c44767100 x1872861960652672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100544.426894:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960652672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100544.426988:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960652800 00000100:00100000:1.0:1786100544.426995:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960652800 00000100:00100000:1.0:1786100544.427137:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786100544.427147:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960652800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100544.427185:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100544.427244:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960652800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100544.427251:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1786100544.427282:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c234000 x1872861960652800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100544.427295:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960652800:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786100544.678118:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100545.706783:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1786100546.150258:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786100546.150265:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c7f9ee000 from 7 10000000:01000000:2.0:1786100546.150270:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786100546.150311:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100546.150323:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100546.150334:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100546.150359:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960652928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786100546.150424:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100546.150478:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4728db40 going to sleep for 11 seconds 00000100:00100000:0.0:1786100546.150679:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960652928 00000100:00100000:0.0:1786100546.150687:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960652928 00000100:00100000:0.0:1786100546.150739:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1786100546.150748:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960652928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786100546.150761:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100546.150774:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0e1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0e13 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100546.150797:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0e1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0e13 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100546.150808:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0e1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0e13 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100546.150817:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb000, rc 0) 00000100:00100000:0.0:1786100546.150857:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960652928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100546.150864:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1786100546.151768:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960652928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786100546.151786:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0e1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100546.151796:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0e1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100546.151854:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100546.151889:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100546.151928:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4728db40 going to sleep for 11 seconds 00000100:00100000:0.0:1786100546.151977:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960653056 00000100:00100000:0.0:1786100546.151983:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960653056 00000100:00100000:0.0:1786100546.152025:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1786100546.152033:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960653056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100546.152275:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960653056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100546.152291:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1786100546.152520:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100546.152561:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100546.152599:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100546.152623:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4728db40 going to sleep for 11 seconds 00000100:00100000:0.0:1786100546.153350:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960653184 00000100:00100000:0.0:1786100546.153356:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960653184 00000100:00100000:0.0:1786100546.153395:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1786100546.153404:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960653184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100546.153565:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960653184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100546.153572:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1786100546.153675:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786100546.172387:0:11248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1786100546.172616:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1786100546.172640:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786100546.172678:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0e1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100546.172690:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0e1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100546.172700:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786100546.172703:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c6e163000 from 7 10000000:01000000:2.0:1786100546.172705:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786100546.172740:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100546.172748:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100546.172758:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100546.172784:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786100546.172844:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100546.172881:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4728d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100546.174401:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960653312 00000100:00100000:3.0:1786100546.174412:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960653312 00000100:00100000:3.0:1786100546.174458:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1786100546.174474:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960653312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100546.174489:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100546.174502:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac0e28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0e21 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100546.174527:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac0e28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0e21 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100546.174536:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac0e28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0e21 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100546.174545:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99400, rc 0) 00000100:00100000:3.0:1786100546.174601:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960653312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (1757us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100546.174608:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1786100546.177797:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786100546.177836:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0e28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100546.177849:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0e28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100546.177927:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100546.177983:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100546.178029:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4728d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100546.178049:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960653440 00000100:00100000:2.0:1786100546.178055:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960653440 00000100:00100000:2.0:1786100546.178094:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1786100546.178104:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960653440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100546.178354:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960653440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100546.178362:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1786100546.178401:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100546.178430:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100546.178468:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100546.178493:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4728d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100546.179017:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960653568 00000100:00100000:2.0:1786100546.179023:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960653568 00000100:00100000:2.0:1786100546.179053:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1786100546.179061:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960653568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100546.180101:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960653568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1035us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100546.180125:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1786100546.180197:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786100546.184286:0:11256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1786100546.190127:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1786100546.190161:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786100546.190173:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0e28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100546.190186:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0e28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100546.190197:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786100546.190199:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c47abb000 from 7 10000000:01000000:0.0:1786100546.190202:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786100546.190294:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100546.190303:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100546.190315:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100546.190339:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786100546.190407:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100546.190451:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67900 going to sleep for 11 seconds 00000100:00100000:2.0:1786100546.190546:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960653696 00000100:00100000:2.0:1786100546.190553:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960653696 00000100:00100000:2.0:1786100546.190603:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1786100546.190613:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960653696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786100546.190626:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100546.190637:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0e36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0e2f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100546.190681:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0e36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0e2f expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100546.190692:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0e36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0e2f expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100546.190701:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0a400, rc 0) 00000100:00100000:2.0:1786100546.190741:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960653696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100546.190747:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1786100546.191394:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786100546.191411:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0e36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100546.191420:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0e36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100546.191478:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100546.191510:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100546.191534:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67900 going to sleep for 11 seconds 00000100:00100000:2.0:1786100546.191579:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960653824 00000100:00100000:2.0:1786100546.191585:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960653824 00000100:00100000:2.0:1786100546.191620:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1786100546.191627:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960653824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100546.191872:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960653824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100546.191888:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1786100546.192115:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100546.199366:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100546.199454:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100546.199502:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67900 going to sleep for 11 seconds 00000100:00100000:3.0:1786100546.199978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100546.200006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100546.200029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100546.200052:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941742464 00000100:00100000:3.0:1786100546.200059:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941742464 00000100:00100000:3.0:1786100546.200106:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941742592 00000100:00100000:3.0:1786100546.200110:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941742592 00000100:00100000:3.0:1786100546.200133:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 91 00000100:00100000:3.0:1786100546.200143:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2352:x1872861941742464:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100546.200204:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2352:x1872861941742464:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 62us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100546.200212:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 91 00000100:00100000:3.0:1786100546.200334:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 92 00000100:00100000:3.0:1786100546.200349:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+5:2352:x1872861941742592:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100546.200376:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+5:2352:x1872861941742592:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 29us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100546.200383:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 92 00000100:00100000:3.0:1786100546.200403:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960653952 00000100:00100000:3.0:1786100546.200406:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960653952 00000100:00100000:3.0:1786100546.201791:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941742336 00000100:00100000:3.0:1786100546.201801:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941742336 00000100:00100000:0.0:1786100546.204349:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1786100546.204370:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960653952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100546.204603:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960653952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (5148us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100546.204612:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1786100546.204671:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 239 00000100:00100000:0.0:1786100546.204680:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+11:2352:x1872861941742336:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100546.204719:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+11:2352:x1872861941742336:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 40us (4711us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100546.204732:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 239 00000100:00100000:0.0:1786100546.204784:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960653952:0@lo:503:ll_cfg_requeue.0 00000100:00080000:1.0:1786100546.205372:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1786100546.210571:0:11258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1786100546.213869:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1786100546.213908:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786100546.213920:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0e36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100546.213932:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0e36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100546.258990:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100546.259085:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941742720 00000100:00100000:2.0:1786100546.259097:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941742720 00000100:00100000:2.0:1786100546.259151:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 240 00000100:00100000:2.0:1786100546.259160:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+11:5592:x1872861941742720:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786100546.259175:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100546.259191:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0e3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2e78 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100546.259218:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0e3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e78 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100546.259240:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0e3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e78 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100546.259249:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0b200, rc 0) 00000100:00100000:2.0:1786100546.259306:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+12:5592:x1872861941742720:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 147us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100546.259312:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 240 00000100:00100000:2.0:1786100546.267987:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100546.268364:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941742848 00000100:00100000:3.0:1786100546.268373:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941742848 00000100:00100000:3.0:1786100546.268456:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 241 00000100:00100000:3.0:1786100546.268466:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+12:5592:x1872861941742848:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786100546.269507:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+12:5592:x1872861941742848:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 1036us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100546.269517:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 241 00000100:00100000:0.0:1786100546.279867:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100546.281552:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941742976 00000100:00100000:3.0:1786100546.281574:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941742976 00000100:00100000:3.0:1786100546.281638:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 242 00000100:00100000:3.0:1786100546.281647:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+12:5592:x1872861941742976:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786100546.281886:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+12:5592:x1872861941742976:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 239us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100546.281895:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 242 00000100:00100000:0.0:1786100546.289189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100546.289429:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941743104 00000100:00100000:3.0:1786100546.289439:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941743104 00000100:00100000:3.0:1786100546.289494:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 243 00000100:00100000:3.0:1786100546.289503:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+12:5592:x1872861941743104:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100546.289528:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100546.289543:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac0e44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2e7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100546.289581:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac0e44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e7f expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100546.289592:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac0e44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e7f expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100546.289600:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98600, rc 0) 00000100:00100000:3.0:1786100546.289671:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:5592:x1872861941743104:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 169us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100546.289679:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 243 00000100:00100000:0.0:1786100546.294136:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100546.296990:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941743232 00000100:00100000:1.0:1786100546.297006:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941743232 00000100:00100000:1.0:1786100546.297066:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 244 00000100:00100000:1.0:1786100546.297076:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:5592:x1872861941743232:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100546.298731:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:5592:x1872861941743232:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 1647us (4593us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100546.298745:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 244 00000100:00100000:1.0:1786100546.303577:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100546.303708:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941743360 00000100:00100000:0.0:1786100546.303719:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941743360 00000100:00100000:0.0:1786100546.303778:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 245 00000100:00100000:0.0:1786100546.303788:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+13:5592:x1872861941743360:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100546.303999:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+13:5592:x1872861941743360:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 211us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100546.304007:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 245 00010000:00010000:0.0:1786100546.734426:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100547.748830:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786100547.998200:0:11375:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1786100548.773469:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100549.030074:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960654080:0@lo:400:kworker.0 00000100:00100000:0.0:1786100549.030144:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100549.030203:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960654592:0@lo:400:kworker.0 00000100:00100000:0.0:1786100549.030239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100549.030262:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786100549.030268:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960654208:0@lo:400:kworker.0 00000100:00100000:0.0:1786100549.030287:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100549.030300:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960654720:0@lo:400:kworker.0 00000100:00100000:0.0:1786100549.030351:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100549.031230:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960654592 00000100:00100000:3.0:1786100549.031239:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960654592 00000100:00100000:3.0:1786100549.031283:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960654208 00000100:00100000:3.0:1786100549.031286:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960654208 00000100:00100000:3.0:1786100549.031302:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1786100549.031310:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960654592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100549.031371:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960654592:12345-0@lo:400:kworker.0 Request processed in 62us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100549.031377:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1786100549.031391:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1786100549.031397:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960654208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100549.031419:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960654208:12345-0@lo:400:kworker.0 Request processed in 23us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100549.031436:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1786100549.031469:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960654208:0@lo:400:kworker.0 00000100:00100000:3.0:1786100549.031479:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960654592:0@lo:400:kworker.0 00000100:00100000:1.0:1786100549.031816:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960654336:0@lo:400:kworker.0 00000100:00100000:1.0:1786100549.031857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100549.031891:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786100549.031898:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960654464:0@lo:400:kworker.0 00000100:00100000:1.0:1786100549.031920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100549.031969:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960654336 00000100:00100000:1.0:1786100549.031973:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960654336 00000100:00100000:1.0:1786100549.031997:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1786100549.032002:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960654336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100549.032035:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960654336:12345-0@lo:400:kworker.0 Request processed in 32us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100549.032040:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1786100549.032056:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960654720 00000100:00100000:1.0:1786100549.032059:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960654720 00000100:00100000:1.0:1786100549.032080:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960654464 00000100:00100000:1.0:1786100549.032082:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960654464 00000100:00100000:1.0:1786100549.032098:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786100549.032104:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960654720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100549.032133:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960654720:12345-0@lo:400:kworker.0 Request processed in 29us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100549.032149:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786100549.032159:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786100549.032165:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960654464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100549.032189:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960654464:12345-0@lo:400:kworker.0 Request processed in 24us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100549.032193:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1786100549.032217:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786100549.032221:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786100549.032229:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786100549.032261:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d3800 x1872861960654464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100549.032271:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960654464:0@lo:400:kworker.0 00000100:00100000:1.0:1786100549.032279:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960654336:0@lo:400:kworker.0 00010000:00080000:3.0:1786100549.033030:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d3100 x1872861960654720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100549.033044:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960654720:0@lo:400:kworker.0 00000100:00100000:2.0:1786100549.033160:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960654080 00000100:00100000:2.0:1786100549.033168:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960654080 00000100:00100000:2.0:1786100549.033225:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1786100549.033234:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960654080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100549.033315:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960654080:12345-0@lo:400:kworker.0 Request processed in 82us (3169us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100549.033337:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1786100549.033376:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960654080:0@lo:400:kworker.0 00000100:00100000:3.0:1786100549.541437:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786100549.541469:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960654848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100549.541560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100549.541686:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960654848 00000100:00100000:2.0:1786100549.541696:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960654848 00000100:00100000:2.0:1786100549.541771:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1786100549.541784:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960654848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786100549.541831:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100549.541894:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960654848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100549.541902:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1786100549.542246:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d2d80 x1872861960654848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100549.542269:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960654848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100549.545935:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786100549.546059:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960654976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100549.546149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100549.546298:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960654976 00000100:00100000:2.0:1786100549.546378:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960654976 00000100:00100000:2.0:1786100549.546471:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786100549.546483:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960654976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786100549.546524:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100549.546586:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960654976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100549.546594:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1786100549.546689:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c745d1c00 x1872861960654976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100549.546713:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960654976:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786100549.797291:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100550.824453:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100551.308341:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100551.308415:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100551.308441:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100551.308470:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941743744 00000100:00100000:1.0:1786100551.308478:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941743744 00000100:00100000:1.0:1786100551.308527:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941743616 00000100:00100000:1.0:1786100551.308530:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941743616 00000100:00100000:1.0:1786100551.308550:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 96 00000100:00100000:1.0:1786100551.308560:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941743744:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100551.308628:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941743744:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 68us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100551.308636:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 96 00000100:00100000:1.0:1786100551.308678:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 97 00000100:00100000:1.0:1786100551.308686:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941743616:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100551.308713:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941743616:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100551.308718:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 97 00000100:00080000:1.0:1786100551.308734:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100551.308997:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941743488 00000100:00100000:3.0:1786100551.309002:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941743488 00000100:00100000:3.0:1786100551.309046:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 247 00000100:00100000:3.0:1786100551.309054:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2353:x1872861941743488:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100551.309084:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2353:x1872861941743488:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 31us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100551.309102:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 247 00010000:00010000:0.0:1786100551.845481:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786100551.986107:0:11477:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 07:02:29 (1786100549) === 00000100:00100000:1.0:1786100552.293103:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100552.293160:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100552.293371:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941743872 00000100:00100000:3.0:1786100552.293380:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941743872 00000100:00100000:3.0:1786100552.293440:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:3.0:1786100552.293451:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2352:x1872861941743872:12345-192.168.206.53@tcp:41:mkdir.0 00000004:00000024:3.0:1786100552.293494:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786100552.293733:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941744000 00000100:00100000:2.0:1786100552.293738:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941744000 00000100:00100000:2.0:1786100552.293772:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:2.0:1786100552.293779:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d2a93440-3d3b-4616-8388-e39125c10990+7:9691:x1872861941744000:12345-192.168.206.53@tcp:700:mkdir.0 00000100:00100000:3.0:1786100552.294254:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941743872:12345-192.168.206.53@tcp:41:mkdir.0 Request processed in 803us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100552.294267:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:2.0:1786100552.294692:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d2a93440-3d3b-4616-8388-e39125c10990+6:9691:x1872861941744000:12345-192.168.206.53@tcp:700:mkdir.0 Request processed in 912us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100552.294700:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:1.0:1786100552.297223:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100552.297308:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941744256 00000100:00100000:3.0:1786100552.297317:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941744256 00000100:00100000:3.0:1786100552.297376:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:3.0:1786100552.297385:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:9691:x1872861941744256:12345-192.168.206.53@tcp:36:mkdir.0 00010000:00010000:3.0:1786100552.297450:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100552.297509:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0d2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e01 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.297530:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c461b1a00) 00010000:00010000:3.0:1786100552.297551:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786100552.297908:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac0e4b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.297927:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac0e4b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.297937:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac0e4b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.297956:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e52 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.297963:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e52 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.297970:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e52 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100552.299896:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1786100552.299911:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac0e4b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.299920:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac0e4b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.299927:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac0e4b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.299934:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99e00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100552.299937:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac0e4b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.299945:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac0e4b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.299965:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454ab100) 00010000:00010000:3.0:1786100552.299967:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100552.299971:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac0e4b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.299989:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac0e4b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786100552.300011:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c83234b7 reply state 00000000f1f7c62d transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e52 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100552.300021:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786100552.300588:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+7:9691:x1872861941744256:12345-192.168.206.53@tcp:36:mkdir.0 Request processed in 3196us (3364us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1786100552.300600:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00010000:00010000:3.0:1786100552.307401:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e52 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.307417:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e52 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.307425:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e52 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.307432:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100552.307436:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e52 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.307444:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e52 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.307460:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a3c454aba00) 00010000:00010000:3.0:1786100552.307463:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100552.307467:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e52 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.307488:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e52 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100552.317539:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100552.317785:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941744384 00000100:00100000:0.0:1786100552.317794:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941744384 00000100:00100000:0.0:1786100552.317849:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:0.0:1786100552.317858:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:9692:x1872861941744384:12345-192.168.206.53@tcp:101:chmod.0 00010000:00010000:0.0:1786100552.317880:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100552.317905:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac0e59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2e86 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.317967:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0e60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.317980:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0e60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.317992:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0e60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100552.318045:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1786100552.318049:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1786100552.318089:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0e60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.318114:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac0e59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e86 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.318150:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0e60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e86 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.318159:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c433df700) 00010000:00010000:0.0:1786100552.318162:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786100552.318170:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbae00, rc 0) 00000100:00100000:0.0:1786100552.318244:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:9692:x1872861941744384:12345-192.168.206.53@tcp:101:chmod.0 Request processed in 386us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100552.318251:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:1.0:1786100552.330986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100552.331082:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941744640 00000100:00100000:2.0:1786100552.331092:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941744640 00000100:00100000:2.0:1786100552.331168:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:2.0:1786100552.331178:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:9692:x1872861941744640:12345-192.168.206.53@tcp:36:chmod.0 00010000:00010000:2.0:1786100552.331245:0:9953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100552.331272:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0e60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e86 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.331292:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c433df700) 00010000:00010000:2.0:1786100552.331302:0:9953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100552.331326:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e67 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.331338:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.331348:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100552.331633:0:9953:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7216f8a reply state 000000004f007f48 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100552.331643:0:9953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1786100552.331710:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1786100552.331783:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+8:9692:x1872861941744640:12345-192.168.206.53@tcp:36:chmod.0 Request processed in 606us (806us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1786100552.331791:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00010000:00010000:0.0:1786100552.337610:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.337626:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e67 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.337633:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.337639:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0bc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100552.337644:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.337678:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e67 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.337695:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c58043000) 00010000:00010000:0.0:1786100552.337698:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786100552.337702:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e67 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.337719:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e67 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100552.388493:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100552.388586:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941744768 00000100:00100000:0.0:1786100552.388597:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941744768 00000100:00100000:0.0:1786100552.388682:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:0.0:1786100552.388693:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:9694:x1872861941744768:12345-192.168.206.53@tcp:101:chown.0 00010000:00010000:0.0:1786100552.388715:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100552.388737:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac0e6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2e8d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.389122:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac0e75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.389136:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac0e75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.389146:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac0e75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100552.389220:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1786100552.389224:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1786100552.389263:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac0e75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.389290:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac0e6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e8d expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.389308:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac0e75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e8d expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.389328:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c433dfc00) 00010000:00010000:0.0:1786100552.389332:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786100552.389335:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb800, rc 0) 00000100:00100000:0.0:1786100552.389398:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+8:9694:x1872861941744768:12345-192.168.206.53@tcp:101:chown.0 Request processed in 706us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100552.389406:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:1.0:1786100552.393957:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100552.394057:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941744896 00000100:00100000:2.0:1786100552.394067:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941744896 00000100:00100000:2.0:1786100552.394126:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:2.0:1786100552.394136:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+8:9694:x1872861941744896:12345-192.168.206.53@tcp:101:chown.0 00010000:00010000:2.0:1786100552.394184:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100552.394220:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac0e7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2e94 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394286:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0e83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394300:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0e83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394310:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0e83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394325:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394332:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394339:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394429:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac0e91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394438:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac0e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394445:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac0e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100552.394482:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1786100552.394491:0:9953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100552.394522:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac0e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394535:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0e83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394542:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0e83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394549:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0e83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394555:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100552.394559:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0e83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394567:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0e83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394580:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c433dfc00) 00010000:00010000:2.0:1786100552.394582:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100552.394587:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0e83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394593:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0e83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394605:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394612:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394628:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394633:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0bc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100552.394636:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394643:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394694:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a3c58043c00) 00010000:00010000:2.0:1786100552.394698:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100552.394701:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394706:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0e8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394739:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac0e7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e94 expref: 10 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394753:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac0e91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e94 expref: 9 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.394761:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a3c58043a00) 00010000:00010000:2.0:1786100552.394763:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786100552.394766:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0a800, rc 0) 00000100:00100000:2.0:1786100552.394813:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+9:9694:x1872861941744896:12345-192.168.206.53@tcp:101:chown.0 Request processed in 679us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100552.394829:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:1.0:1786100552.401460:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100552.401537:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941745152 00000100:00100000:3.0:1786100552.401547:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941745152 00000100:00100000:3.0:1786100552.401603:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:3.0:1786100552.401613:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+9:9694:x1872861941745152:12345-192.168.206.53@tcp:36:chown.0 00010000:00010000:3.0:1786100552.401699:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100552.401725:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac0e91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e94 expref: 9 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.401742:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a3c58043a00) 00010000:00010000:3.0:1786100552.401755:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786100552.401779:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.401802:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.401812:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786100552.463152:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1786100552.463166:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1786100552.463239:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000802a10b0 reply state 00000000b1d05cb5 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100552.463251:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1786100552.463397:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1786100552.463527:0:5844:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1786100552.463551:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+7:9694:x1872861941745152:12345-192.168.206.53@tcp:36:chown.0 Request processed in 61935us (62094us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1786100552.463568:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00010000:00010000:2.0:1786100552.463635:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.463644:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.463683:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.463689:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100552.463694:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.463701:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.463716:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a3c454aba00) 00010000:00010000:2.0:1786100552.463719:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786100552.463723:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.463730:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac0e98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100552.504041:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100552.510071:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941745280 00000100:00100000:2.0:1786100552.510089:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941745280 00000100:00100000:3.0:1786100552.513120:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:3.0:1786100552.513136:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:9695:x1872861941745280:12345-192.168.206.53@tcp:101:touch.500 00010000:00010000:3.0:1786100552.513168:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100552.513967:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac0e9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2e9b expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786100552.520160:0:9953:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6137us 00010000:00010000:1.0:1786100552.558131:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ea6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.558153:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ea6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.558165:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ea6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.558181:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ead lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.558200:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.558207:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.558717:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac0eb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.558727:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac0eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.558870:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac0eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100552.558952:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786100552.558957:0:9953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100552.559116:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac0eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559129:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ea6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559135:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ea6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559141:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ea6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559147:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100552.559151:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ea6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559158:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ea6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559171:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c433dfc00) 00010000:00010000:1.0:1786100552.559173:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100552.559178:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ea6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559183:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ea6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559216:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559223:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ead lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559228:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ead lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559232:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100552.559236:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ead lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559242:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ead lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559249:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a3c461b1100) 00010000:00010000:1.0:1786100552.559251:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100552.559254:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ead lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559260:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ead lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559296:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac0e9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e9b expref: 8 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559375:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac0eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e9b expref: 7 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.559394:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a3c461b1800) 00010000:00010000:1.0:1786100552.559397:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786100552.559399:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62387c00, rc 0) 00000100:00100000:1.0:1786100552.559528:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:9695:x1872861941745280:12345-192.168.206.53@tcp:101:touch.500 Request processed in 46394us (55494us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100552.559537:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:0.0:1786100552.567792:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100552.567954:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941745536 00000100:00100000:1.0:1786100552.567964:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941745536 00000100:00100000:1.0:1786100552.568020:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:1.0:1786100552.568030:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:9695:x1872861941745536:12345-192.168.206.53@tcp:101:touch.500 00010000:00010000:1.0:1786100552.568157:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100552.568179:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ebb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2ea2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.568608:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ec2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.568622:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ec2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.568633:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ec2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.569271:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac0ec9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.569284:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac0ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.569304:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac0ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786100552.573776:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1786100552.574071:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac0ed0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.574087:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac0ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.574098:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac0ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.574135:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ec2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.574142:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ec2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.574149:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ec2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.574155:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100552.574159:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ec2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.574167:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ec2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.574180:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a3c461b1800) 00010000:00010000:1.0:1786100552.574183:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100552.574204:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ec2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.574210:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0ec2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786100552.574224:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007abd21ad reply state 00000000b0ca4cd5 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac0ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100552.574233:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786100552.574267:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ebb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ea2 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.574281:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac0ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ea2 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.574288:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a3c461b1200) 00010000:00010000:1.0:1786100552.574291:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786100552.574293:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386600, rc 0) 00000100:00100000:1.0:1786100552.574360:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+10:9695:x1872861941745536:12345-192.168.206.53@tcp:101:touch.500 Request processed in 6330us (6575us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1786100552.574368:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 22 00010000:00010000:2.0:1786100552.581392:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac0ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.581426:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac0ec9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.581434:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac0ec9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.581441:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386e00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100552.581445:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac0ec9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.581454:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac0ec9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.581470:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff9a3c461b1100) 00010000:00010000:2.0:1786100552.581474:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100552.581478:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac0ec9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.581485:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac0ec9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100552.590962:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100552.591361:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941745792 00000100:00100000:3.0:1786100552.591371:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941745792 00000100:00100000:3.0:1786100552.591442:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:3.0:1786100552.591453:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+9:9695:x1872861941745792:12345-192.168.206.53@tcp:36:touch.500 00010000:00010000:3.0:1786100552.591516:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100552.591543:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac0ed0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ea2 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.591563:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a3c461b1200) 00010000:00010000:3.0:1786100552.591573:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786100552.591626:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac0ede lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.591639:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac0ede lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.591648:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac0ede lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786100552.591863:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a6759b8 reply state 00000000be1efa1f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac0ede lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100552.591871:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786100552.592300:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+10:9695:x1872861941745792:12345-192.168.206.53@tcp:36:touch.500 Request processed in 848us (1345us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1786100552.592309:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 23 00010000:00010000:2.0:1786100552.595720:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac0ede lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.595747:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac0ede lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.595755:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac0ede lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.595761:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100552.595779:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac0ede lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.595787:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac0ede lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.595820:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a3c454ab600) 00010000:00010000:2.0:1786100552.595824:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100552.595828:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac0ede lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100552.595835:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac0ede lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100552.599814:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100552.599967:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941745920 00000100:00100000:3.0:1786100552.599977:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941745920 00000100:00100000:3.0:1786100552.600044:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:3.0:1786100552.600055:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+9:9695:x1872861941745920:12345-192.168.206.53@tcp:101:touch.500 00010000:00010000:3.0:1786100552.600080:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100552.600101:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac0ee5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2ea9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.600154:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac0ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ea9 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.600167:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac0ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ea9 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.600194:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a3c454ab100) 00010000:00010000:3.0:1786100552.600197:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786100552.600200:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98a00, rc 0) 00000100:00100000:3.0:1786100552.600252:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+10:9695:x1872861941745920:12345-192.168.206.53@tcp:101:touch.500 Request processed in 200us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100552.600259:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:1.0:1786100552.608404:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100552.608482:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941746048 00000100:00100000:2.0:1786100552.608493:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941746048 00000100:00100000:2.0:1786100552.608540:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:2.0:1786100552.608548:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1872861941746048:12345-192.168.206.53@tcp:8:touch.500 00010000:00080000:2.0:1786100552.608580:0:9414:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:2.0:1786100552.608610:0:9414:0:(genops.c:1406:class_connect()) connect: client d2a93440-3d3b-4616-8388-e39125c10990, cookie 0x5564f2c20ac0eec 00002000:00100000:2.0:1786100552.608622:0:9414:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d2a93440-3d3b-4616-8388-e39125c10990/ffff9a3b42764000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786100552.608645:0:9414:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786100552.608916:0:9414:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786100552.608944:0:9414:0:(import.c:65:import_set_state_nolock()) ffff9a3b42767800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786100552.609001:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2350:x1872861941746048:12345-192.168.206.53@tcp:8:touch.500 Request processed in 451us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100552.609010:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:0.0:1786100552.626282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100552.626414:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941746176 00000100:00100000:1.0:1786100552.626423:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941746176 00000100:00100000:1.0:1786100552.626497:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:1.0:1786100552.626508:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:0:x1872861941746176:12345-192.168.206.53@tcp:2:touch.500 00000100:00080000:2.0:1786100552.627340:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1786100552.747433:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1786100552.747461:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2a93440-3d3b-4616-8388-e39125c10990 00000100:00100000:1.0:1786100552.748003:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+5:0:x1872861941746176:12345-192.168.206.53@tcp:2:touch.500 Request processed in 121491us (121722us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1786100552.748023:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:0.0:1786100552.753516:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100552.753622:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941746432 00000100:00100000:2.0:1786100552.753632:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941746432 00000100:00100000:2.0:1786100552.753716:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:2.0:1786100552.753727:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+10:9695:x1872861941746432:12345-192.168.206.53@tcp:35:touch.500 00000100:00100000:2.0:1786100552.754112:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+11:9695:x1872861941746432:12345-192.168.206.53@tcp:35:touch.500 Request processed in 386us (604us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1786100552.754120:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:2.0:1786100552.796452:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100552.797440:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941746560 00000100:00100000:1.0:1786100552.797451:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941746560 00000100:00100000:1.0:1786100552.797516:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:1.0:1786100552.797527:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+11:9696:x1872861941746560:12345-192.168.206.53@tcp:101:rm.0 00010000:00010000:1.0:1786100552.797552:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100552.797627:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ef3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2eb0 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.797731:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0efa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.797744:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0efa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.797766:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0efa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100552.797822:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786100552.797826:0:9953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100552.797865:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0efa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.797890:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac0ef3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2eb0 expref: 13 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.797909:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0efa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2eb0 expref: 12 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.797932:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a3c461b1800) 00010000:00010000:1.0:1786100552.797935:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100552.797938:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386400, rc 0) 00000100:00100000:1.0:1786100552.797990:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+12:9696:x1872861941746560:12345-192.168.206.53@tcp:101:rm.0 Request processed in 465us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100552.797998:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:0.0:1786100552.803718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100552.803856:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941746816 00000100:00100000:3.0:1786100552.803867:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941746816 00000100:00100000:3.0:1786100552.803923:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:3.0:1786100552.803933:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+12:9696:x1872861941746816:12345-192.168.206.53@tcp:101:rm.0 00010000:00010000:3.0:1786100552.803952:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100552.803971:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2eb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100552.804077:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1786100552.804240:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2eb7 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.804255:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c433dfc00) 00010000:00010000:3.0:1786100552.804257:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786100552.804262:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2eb7 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.804274:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99800, rc 0) 00000100:00100000:3.0:1786100552.804332:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+13:9696:x1872861941746816:12345-192.168.206.53@tcp:101:rm.0 Request processed in 401us (625us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1786100552.804339:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:0.0:1786100552.808823:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100552.809001:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941746944 00000100:00100000:3.0:1786100552.809010:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941746944 00000100:00100000:3.0:1786100552.809063:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:3.0:1786100552.809073:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+13:9696:x1872861941746944:12345-192.168.206.53@tcp:37:rm.0 00000100:00100000:3.0:1786100552.818294:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+13:9696:x1872861941746944:12345-192.168.206.53@tcp:37:rm.0 Request processed in 9212us (9470us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100552.818318:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:1.0:1786100552.830109:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100552.830223:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941747200 00000100:00100000:2.0:1786100552.830233:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941747200 00000100:00100000:2.0:1786100552.830289:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:2.0:1786100552.830299:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6af00050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+13:9696:x1872861941747200:12345-192.168.206.53@tcp:35:rm.0 00000100:00100000:2.0:1786100552.830586:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6af00050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+14:9696:x1872861941747200:12345-192.168.206.53@tcp:35:rm.0 Request processed in 287us (484us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1786100552.830598:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:0.0:1786100552.836955:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100552.837011:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941747456 00000100:00100000:3.0:1786100552.837022:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941747456 00000100:00100000:3.0:1786100552.837078:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:3.0:1786100552.837088:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+14:9696:x1872861941747456:12345-192.168.206.53@tcp:101:rm.0 00010000:00010000:3.0:1786100552.837111:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100552.837130:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2ebe expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.837256:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac0f16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.837270:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac0f16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.837282:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac0f16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100552.837293:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1786100552.837459:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ebe expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.837477:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac0f16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ebe expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.837485:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a3c461b1800) 00010000:00010000:3.0:1786100552.837488:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786100552.837491:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99a00, rc 0) 00000100:00100000:3.0:1786100552.837563:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+16:9696:x1872861941747456:12345-192.168.206.53@tcp:101:rm.0 Request processed in 476us (615us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1786100552.837570:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:2.0:1786100552.840748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100552.840967:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941747584 00000100:00100000:0.0:1786100552.840977:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941747584 00000100:00100000:0.0:1786100552.841035:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:0.0:1786100552.841045:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+16:9696:x1872861941747584:12345-192.168.206.53@tcp:41:rm.0 00000004:00000024:0.0:1786100552.841096:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1786100552.841165:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+16:9696:x1872861941747584:12345-192.168.206.53@tcp:41:rm.0 Request processed in 121us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100552.841172:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:0.0:1786100552.849176:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100552.849270:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941747712 00000100:00100000:3.0:1786100552.849280:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941747712 00000100:00100000:3.0:1786100552.849336:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:3.0:1786100552.849347:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+16:9696:x1872861941747712:12345-192.168.206.53@tcp:101:rm.0 00010000:00010000:3.0:1786100552.849368:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100552.849386:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2ec5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849449:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849463:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849473:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849528:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849536:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849543:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849687:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac0f39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849711:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac0f39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849718:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac0f39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100552.849745:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1786100552.849750:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786100552.849773:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac0f39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849785:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac0f39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849793:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849799:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849805:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849811:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100552.849815:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849822:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849833:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a3c461b1800) 00010000:00010000:3.0:1786100552.849836:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100552.849846:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849852:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849864:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849870:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849875:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849880:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100552.849882:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849887:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849894:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff9a3c454abd00) 00010000:00010000:3.0:1786100552.849896:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100552.849898:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849903:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849931:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ec5 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849957:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac0f39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ec5 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.849964:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a3c454ab100) 00010000:00010000:3.0:1786100552.849966:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786100552.849968:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99000, rc 0) 00000100:00100000:3.0:1786100552.850029:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+17:9696:x1872861941747712:12345-192.168.206.53@tcp:101:rm.0 Request processed in 684us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100552.850037:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:2.0:1786100552.855380:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100552.855454:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941747968 00000100:00100000:0.0:1786100552.855463:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941747968 00000100:00100000:0.0:1786100552.855535:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 30 00000100:00100000:0.0:1786100552.855545:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+17:9696:x1872861941747968:12345-192.168.206.53@tcp:36:rm.0 00010000:00010000:0.0:1786100552.855596:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1786100552.855622:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac0f39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ec5 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.855643:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac0ee5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ea9 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.855685:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a3c454ab100) 00010000:00010000:0.0:1786100552.855708:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac0efa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2eb0 expref: 15 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.855717:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a3c461b1800) 00010000:00010000:0.0:1786100552.855720:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786100552.855741:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0f40 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.855763:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0f40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.855772:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0f40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.855786:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac0f47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.855794:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac0f47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.855810:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac0f47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.855962:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0f4e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.855971:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0f4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.855978:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0f4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786100552.856639:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1786100552.856674:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 294099022107ns, next at 295098995477ns, rc = 0 00010000:00010000:0.0:1786100552.856734:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac0f55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856744:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac0f55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856752:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac0f55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856761:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac0f55 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856767:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac0f55 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856773:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac0f55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856808:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786100552.856829:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0f4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856834:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0f4e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856840:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0f4e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856847:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbba00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100552.856851:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0f4e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856858:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0f4e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856869:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:0.0:1786100552.856872:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786100552.856876:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0f4e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856882:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0f4e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856896:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0f40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856901:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0f40 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856906:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0f40 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856916:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100552.856919:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0f40 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856925:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0f40 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856933:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a3c461b1800) 00010000:00010000:0.0:1786100552.856936:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100552.856938:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0f40 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.856944:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0f40 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786100552.856953:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000949b322 reply state 00000000908477ac transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac0f47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100552.856961:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786100552.857049:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+16:9696:x1872861941747968:12345-192.168.206.53@tcp:36:rm.0 Request processed in 1501us (1674us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1786100552.857057:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 30 00010000:00010000:1.0:1786100552.857291:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100552.857298:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac0f55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.857305:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbe00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100552.857309:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac0f55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.857315:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac0f55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.857324:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:1.0:1786100552.857327:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786100552.857330:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac0f55 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.857335:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac0f55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100552.857349:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100552.857351:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100552.857352:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100552.865083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:3.0:1786100552.865232:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac0f47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.865246:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac0f47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.865253:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac0f47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.865259:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100552.865264:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac0f47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.865272:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac0f47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.865288:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff9a3c433df400) 00010000:00010000:3.0:1786100552.865292:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100552.865296:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac0f47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.865316:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac0f47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100552.865506:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941748224 00000100:00100000:0.0:1786100552.865515:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941748224 00000100:00100000:0.0:1786100552.865565:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:0.0:1786100552.865575:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+15:9696:x1872861941748224:12345-192.168.206.53@tcp:35:rm.0 00000100:00100000:0.0:1786100552.866043:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+16:9696:x1872861941748224:12345-192.168.206.53@tcp:35:rm.0 Request processed in 467us (966us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1786100552.866066:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00010000:00010000:1.0:1786100552.869899:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100552.876588:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100552.876702:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941748480 00000100:00100000:3.0:1786100552.876712:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941748480 00000100:00100000:3.0:1786100552.876777:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:3.0:1786100552.876786:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+16:9696:x1872861941748480:12345-192.168.206.53@tcp:36:rm.0 00010000:00010000:3.0:1786100552.876842:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1786100552.876868:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac0f16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ebe expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.876889:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac0eb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e9b expref: 15 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.876901:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a3c461b1800) 00010000:00010000:3.0:1786100552.876918:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac0e75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e8d expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.876926:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c433dfc00) 00010000:00010000:3.0:1786100552.876932:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786100552.876954:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f5c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.876966:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.876975:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.877007:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f63 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.877015:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.877022:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.877330:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.877339:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.877346:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100552.879807:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1786100552.879831:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.879841:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f6a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.879848:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.879855:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100552.879860:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.879880:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f6a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.879896:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a3c454ab100) 00010000:00010000:3.0:1786100552.879899:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786100552.879904:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.879911:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98400/0x5564f2c20ac0f6a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.879934:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.879939:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f5c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.879945:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.879950:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100552.879953:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.879960:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f5c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.879968:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454abd00) 00010000:00010000:3.0:1786100552.879970:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100552.879973:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f5c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100552.879987:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac0f5c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786100552.880000:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecc576c4 reply state 00000000559a636c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100552.880008:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786100552.880258:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+15:9696:x1872861941748480:12345-192.168.206.53@tcp:36:rm.0 Request processed in 3469us (3674us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1786100552.880267:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 31 00010000:00010000:0.0:1786100552.896162:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.896180:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f63 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.896201:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f63 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.896208:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100552.896213:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f63 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.896219:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f63 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.896240:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a3c454abb00) 00010000:00010000:0.0:1786100552.896244:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100552.896248:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f63 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100552.896254:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac0f63 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100553.895572:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100554.148912:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960655360:0@lo:400:kworker.0 00000100:00100000:0.0:1786100554.148995:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100554.149060:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786100554.149071:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960655488:0@lo:400:kworker.0 00000100:00100000:0.0:1786100554.149100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100554.149230:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960655104:0@lo:400:kworker.0 00000100:00100000:2.0:1786100554.149625:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960655232:0@lo:400:kworker.0 00000100:00100000:2.0:1786100554.149701:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100554.149722:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960655744:0@lo:400:kworker.0 00000100:00100000:2.0:1786100554.149741:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100554.149850:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100554.149902:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960655616:0@lo:400:kworker.0 00000100:00100000:1.0:1786100554.149938:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100554.155905:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960655360 00000100:00100000:0.0:1786100554.155925:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960655360 00000100:00100000:0.0:1786100554.156005:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960655232 00000100:00100000:0.0:1786100554.156009:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960655232 00000100:00100000:0.0:1786100554.156025:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960655616 00000100:00100000:0.0:1786100554.156027:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960655616 00000100:00100000:0.0:1786100554.156046:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1786100554.156054:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960655360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100554.156141:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960655360:12345-0@lo:400:kworker.0 Request processed in 87us (7146us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100554.156149:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1786100554.156164:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1786100554.156171:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960655232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100554.156216:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960655232:12345-0@lo:400:kworker.0 Request processed in 46us (6514us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100554.156222:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1786100554.156234:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1786100554.156240:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960655616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100554.156268:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960655616:12345-0@lo:400:kworker.0 Request processed in 28us (6329us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100554.156274:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1786100554.156318:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960655360:0@lo:400:kworker.0 00000100:00100000:0.0:1786100554.156363:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960655104 00000100:00100000:0.0:1786100554.156366:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960655104 00000100:00100000:0.0:1786100554.156392:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1786100554.156398:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960655104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100554.156430:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960655104:12345-0@lo:400:kworker.0 Request processed in 32us (6583us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100554.156448:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1786100554.156480:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960655488 00000100:00100000:0.0:1786100554.156484:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960655488 00000100:00100000:0.0:1786100554.156509:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960655744 00000100:00100000:0.0:1786100554.156512:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960655744 00000100:00100000:0.0:1786100554.156539:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786100554.156546:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960655488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100554.156582:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960655488:12345-0@lo:400:kworker.0 Request processed in 37us (7480us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100554.156589:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786100554.156599:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1786100554.156605:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960655744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100554.156633:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960655744:12345-0@lo:400:kworker.0 Request processed in 27us (6889us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100554.156639:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1786100554.156695:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c459e9880 x1872861960655488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100554.156707:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960655488:0@lo:400:kworker.0 00000100:00100000:0.0:1786100554.157898:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960655104:0@lo:400:kworker.0 00000100:00100000:0.0:1786100554.157916:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960655616:0@lo:400:kworker.0 00000100:00080000:2.0:1786100554.159070:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786100554.159078:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786100554.159096:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100554.159161:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960655232:0@lo:400:kworker.0 00010000:00080000:2.0:1786100554.160378:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c459ebb80 x1872861960655744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100554.160393:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960655744:0@lo:400:kworker.0 00000100:00100000:0.0:1786100554.663574:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960655872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100554.663639:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100554.663833:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960655872 00000100:00100000:1.0:1786100554.663841:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960655872 00000100:00100000:1.0:1786100554.670381:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1786100554.670402:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960655872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786100554.670453:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100554.670538:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960655872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (6897us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100554.670546:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1786100554.670601:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c126300 x1872861960655872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100554.670621:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960655872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100554.670644:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786100554.670676:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960656000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100554.670715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100554.670946:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960656000 00000100:00100000:0.0:1786100554.670954:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960656000 00000100:00100000:0.0:1786100554.671008:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786100554.671015:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960656000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786100554.671036:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100554.671119:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960656000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100554.671125:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1786100554.671150:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c74f0d180 x1872861960656000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100554.671163:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960656000:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1786100554.676528:0:7955:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 295918874421ns, next at 296918872046ns, rc = 0 00010000:00010000:1.0:1786100554.917123:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100555.940790:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100556.430013:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100556.430072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100556.430202:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941748608 00000100:00100000:1.0:1786100556.430213:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941748608 00000100:00100000:1.0:1786100556.430277:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 249 00000100:00100000:1.0:1786100556.430287:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+13:2352:x1872861941748608:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100556.430376:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+13:2352:x1872861941748608:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 89us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100556.430384:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 249 00000100:00100000:2.0:1786100556.430942:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100556.430966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100556.430989:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941748736 00000100:00100000:2.0:1786100556.430993:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941748736 00000100:00100000:2.0:1786100556.431026:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941748992 00000100:00100000:2.0:1786100556.431028:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941748992 00000100:00100000:2.0:1786100556.431046:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 101 00000100:00100000:2.0:1786100556.431053:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+14:2352:x1872861941748736:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100556.431093:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+14:2352:x1872861941748736:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 41us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100556.431099:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 101 00000100:00100000:2.0:1786100556.431110:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 102 00000100:00100000:2.0:1786100556.431115:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+5:2352:x1872861941748992:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100556.431147:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+5:2352:x1872861941748992:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 32us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100556.431153:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 102 00000100:00080000:2.0:1786100556.431177:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100556.437435:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941748864 00000100:00100000:0.0:1786100556.437453:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941748864 00000100:00100000:0.0:1786100556.437539:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:0.0:1786100556.437551:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:2352:x1872861941748864:12345-192.168.206.53@tcp:400:kworker.0 00000100:00080000:2.0:1786100556.437756:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786100556.437945:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:2352:x1872861941748864:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 395us (7870us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100556.437953:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 58 00010000:00010000:1.0:1786100556.964928:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786100557.216415:0:11628:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:2.0:1786100557.787449:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1786100557.787467:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1786100557.787671:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:1.0:1786100557.787909:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1786100557.787927:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1786100557.788012:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960656128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786100557.788081:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100557.788292:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960656128 00000100:00100000:0.0:1786100557.788301:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960656128 00000100:00100000:0.0:1786100557.788948:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786100557.788958:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960656128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786100557.788987:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1786100557.789022:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a75bb47, atime: 0x6a75bb47, ctime: 0x6a75bb47, blocks: 0x1 00010000:00010000:0.0:1786100557.789030:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9508b08/0x5564f2c20ac0f71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100557.789047:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=299s v=(0 0) 00010000:00010000:0.0:1786100557.789063:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100557.789070:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9508b08/0x5564f2c20ac0f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100557.789087:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9508b08/0x5564f2c20ac0f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100557.789097:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9508b08/0x5564f2c20ac0f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100557.789105:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9508b08/0x5564f2c20ac0f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100557.789119:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100557.789242:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100557.789249:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9508b08/0x5564f2c20ac0f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100557.789257:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbac00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100557.789261:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9508b08/0x5564f2c20ac0f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100557.789269:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9508b08/0x5564f2c20ac0f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100557.789288:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9508b08/0x5564f2c20ac0f71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100557.789296:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9508b08/0x5564f2c20ac0f71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100557.789315:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100557.789316:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100557.789318:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100557.790182:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1872861960656128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1221us (2096us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1786100557.790192:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1786100557.790349:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1786100557.790410:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a3c459e9500/2, rc 0, transno 4294967300 00000100:00100000:3.0:1786100557.790417:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960656128:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786100557.989439:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786100558.380935:0:11678:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0b5db900 20000000:00000080:2.0:1786100558.380949:0:11678:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a3c74857400 uarg=0000000000000000 20000000:01000000:2.0:1786100558.380982:0:11678:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1786100558.380988:0:11678:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1786100558.380992:0:11678:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1786100558.381928:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1786100558.382068:0:11678:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1786100558.387789:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1786100558.387838:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1786100558.387883:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1786100558.387900:0:11678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1786100558.387919:0:11678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100558.387937:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0e1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0e13 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100558.387946:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac0e28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0e21 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100558.387952:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0e36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0e2f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100558.387961:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0e3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e78 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100558.387968:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac0e44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e7f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100558.387975:0:11678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100558.388009:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac0e44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e7f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100558.388024:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac0e44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e7f expref: 12 pid: 5837 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100558.388050:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1872861960656256:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100558.388140:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0e3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e78 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100558.388148:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0e3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e78 expref: 12 pid: 5838 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100558.388172:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1872861960656384:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100558.388199:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0e36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0e2f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100558.388206:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0e36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0e2f expref: 18 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100558.388215:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1872861960656512:0@lo:104: 00000100:00100000:1.0:1786100558.388245:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786100558.388270:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac0e28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0e21 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100558.388277:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac0e28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0e21 expref: 18 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100558.388285:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1872861960656640:0@lo:104: 00000100:00100000:0.0:1786100558.388389:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960656512 00000100:00100000:0.0:1786100558.388396:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960656512 00000100:00100000:0.0:1786100558.388446:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786100558.388454:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:11678:x1872861960656512:12345-0@lo:104: 00010000:00010000:0.0:1786100558.388466:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0e36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.388809:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786100558.388816:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:11678:x1872861960656512:12345-0@lo:104: Request processed in 363us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100558.388832:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1786100558.389040:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100558.389047:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0e36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100558.389055:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:3.0:1786100558.389059:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0e36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100558.389068:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0e36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786100558.389076:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0e36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100558.389081:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786100558.389113:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0e36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100558.389124:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786100558.389143:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0e36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100558.389163:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbbc00/0x5564f2c20ac0e2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0e36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100558.389177:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100558.389179:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100558.389180:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100558.389192:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960656768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786100558.389221:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100558.389260:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960656768 00000100:00100000:3.0:1786100558.389263:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960656768 00010000:00010000:3.0:1786100558.389280:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0e36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0e2f expref: 19 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100558.389312:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786100558.389318:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960656768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786100558.389327:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100558.389332:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0e36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0e2f expref: 19 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100558.389340:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0e36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0e2f expref: 19 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100558.389355:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100558.389377:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960656768:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100558.389388:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786100558.389430:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960656768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786100558.390072:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786100558.390207:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0e1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac0e13 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100558.390220:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0e1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac0e13 expref: 18 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100558.390238:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1872861960656896:0@lo:104: 00000100:00100000:1.0:1786100558.390266:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100558.390381:0:11678:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4473fc00 going to sleep for 11 seconds 00010000:00010000:1.0:1786100558.390395:0:11678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0a400/0x5564f2c20ac0e36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0e2f expref: 18 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100558.390415:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1872861960656512:0@lo:104: 00000100:00100000:0.0:1786100558.390533:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786100558.390544:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960656640 00000100:00100000:0.0:1786100558.390549:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960656640 00000100:00100000:0.0:1786100558.390583:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960656896 00000100:00100000:0.0:1786100558.390586:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960656896 00000100:00100000:0.0:1786100558.390598:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786100558.390605:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:11678:x1872861960656640:12345-0@lo:104: 00010000:00010000:0.0:1786100558.390613:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0e28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.390688:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786100558.390694:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+4:11678:x1872861960656640:12345-0@lo:104: Request processed in 89us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100558.390700:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786100558.390713:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786100558.390718:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f85d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:11678:x1872861960656896:12345-0@lo:104: 00010000:00010000:0.0:1786100558.390725:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0e1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.390752:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1786100558.390758:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f85d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+3:11678:x1872861960656896:12345-0@lo:104: Request processed in 40us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100558.390763:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1786100558.390792:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786100558.390797:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0e28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.390814:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a200 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100558.390818:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0e28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.390826:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0e28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100558.390832:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0e28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100558.390837:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786100558.390861:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0e28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.390867:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100558.390884:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0e28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.390890:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a200/0x5564f2c20ac0e21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0e28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.390900:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100558.390903:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac0e1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.390907:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0be00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100558.390910:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac0e1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.390926:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac0e1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100558.390931:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac0e1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100558.390935:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786100558.390947:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0e1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.390952:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100558.390957:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0e1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.390962:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0e13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac0e1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.390974:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100558.390975:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100558.390977:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100558.390983:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100558.390992:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960657152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786100558.391019:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100558.391076:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786100558.391083:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960657024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786100558.391107:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100558.391131:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960657152 00000100:00100000:0.0:1786100558.391135:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960657152 00000100:00100000:3.0:1786100558.391274:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1872861960656640:0@lo:104: 00000100:00100000:3.0:1786100558.391283:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1872861960656896:0@lo:104: 00010000:00010000:0.0:1786100558.391412:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0e1a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0e13 expref: 18 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100558.391447:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960657024 00000100:00100000:0.0:1786100558.391450:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960657024 00010000:00010000:0.0:1786100558.391461:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac0e28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0e21 expref: 19 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100558.391478:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786100558.391484:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3306:x1872861960657152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786100558.391493:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100558.391498:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0e1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0e13 expref: 19 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.391506:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0e1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0e13 expref: 19 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.391518:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0e1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0e13 expref: 19 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.391529:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100558.391556:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:3306:x1872861960657152:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100558.391561:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786100558.391572:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786100558.391576:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d76050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:3306:x1872861960657024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786100558.391582:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100558.391586:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac0e28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac0e21 expref: 17 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.391593:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac0e28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac0e21 expref: 17 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.391608:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac0e28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac0e21 expref: 17 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.391616:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100558.391634:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d76050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:3306:x1872861960657024:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100558.391640:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786100558.391953:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960657024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786100558.391961:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960657152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786100558.392375:0:8453:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1786100558.397287:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1872861960656256:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100558.403777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100558.404108:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1872861960656384:192.168.206.53@tcp:104: 00010000:00010000:3.0:1786100558.404160:0:11678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100558.404555:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941749120 00000100:00100000:0.0:1786100558.404564:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941749120 00010000:00010000:0.0:1786100558.404601:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac0e44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e7f expref: 13 pid: 5837 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100558.404637:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:0.0:1786100558.404647:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d69173c-d092-48de-a520-1459f9171aec+13:2352:x1872861941749120:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100558.404682:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100558.404688:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac0e44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e7f expref: 13 pid: 5837 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.404699:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac0e44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e7f expref: 13 pid: 5837 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.404728:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac0e44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e7f expref: 13 pid: 5837 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.404743:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100558.404814:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d69173c-d092-48de-a520-1459f9171aec+12:2352:x1872861941749120:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 168us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100558.404822:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:2.0:1786100558.413941:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100558.414037:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941749248 00000100:00100000:0.0:1786100558.414050:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941749248 00010000:00010000:0.0:1786100558.414086:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0e3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e78 expref: 12 pid: 5838 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100558.414134:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:0.0:1786100558.414143:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d69173c-d092-48de-a520-1459f9171aec+12:2351:x1872861941749248:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100558.414172:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100558.414179:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0e3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e78 expref: 12 pid: 5838 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.414191:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0e3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e78 expref: 12 pid: 5838 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.414210:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0e3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e78 expref: 12 pid: 5838 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.414227:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.414235:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.414251:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.414259:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.414278:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.414284:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.414291:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386e00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100558.414296:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.414303:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.414328:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100558.414340:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100558.414398:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d69173c-d092-48de-a520-1459f9171aec+11:2351:x1872861941749248:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 254us (464us total) trans 0 rc 0/0 00010000:00010000:1.0:1786100558.414403:0:11678:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100558.414407:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 34 00010000:00010000:1.0:1786100558.414426:0:11678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100558.414433:0:11678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac0f78 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100559.012909:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100559.269395:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960657664:0@lo:400:kworker.0 00000100:00100000:1.0:1786100559.269460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100559.269520:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786100559.269526:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960657536:0@lo:400:kworker.0 00000100:00100000:1.0:1786100559.269550:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100559.269577:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960657664 00000100:00100000:1.0:1786100559.269583:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960657664 00000100:00100000:1.0:1786100559.269631:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786100559.269640:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960657664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100559.269711:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960657664:12345-0@lo:400:kworker.0 Request processed in 72us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100559.269732:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1786100559.269772:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429ac380 x1872861960657664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100559.269785:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960657664:0@lo:400:kworker.0 00000100:00100000:2.0:1786100559.269869:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960657408:0@lo:400:kworker.0 00000100:00100000:2.0:1786100559.269898:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100559.269924:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960657920:0@lo:400:kworker.0 00000100:00100000:2.0:1786100559.269943:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100559.269965:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786100559.269970:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960657280:0@lo:400:kworker.0 00000100:00100000:2.0:1786100559.269992:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100559.270008:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960657792:0@lo:400:kworker.0 00000100:00100000:2.0:1786100559.270023:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100559.270044:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960657536 00000100:00100000:2.0:1786100559.270047:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960657536 00000100:00100000:2.0:1786100559.270074:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960657408 00000100:00100000:2.0:1786100559.270083:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960657408 00000100:00100000:2.0:1786100559.270097:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960657792 00000100:00100000:2.0:1786100559.270100:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960657792 00000100:00100000:2.0:1786100559.270112:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1786100559.270118:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960657536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100559.270175:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960657536:12345-0@lo:400:kworker.0 Request processed in 56us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100559.270181:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1786100559.270194:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1786100559.270200:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960657408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100559.270231:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960657408:12345-0@lo:400:kworker.0 Request processed in 31us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100559.270236:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1786100559.270247:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1786100559.270252:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960657792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100559.270275:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960657792:12345-0@lo:400:kworker.0 Request processed in 23us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100559.270280:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1786100559.270294:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786100559.270298:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786100559.270306:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960657920 00000100:00100000:2.0:1786100559.270309:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960657920 00000100:00100000:2.0:1786100559.270332:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1786100559.270338:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1872861960657920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100559.270364:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1872861960657920:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100559.270369:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1786100559.270393:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786100559.270410:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960657792:0@lo:400:kworker.0 00000100:00100000:2.0:1786100559.270418:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960657408:0@lo:400:kworker.0 00000100:00100000:2.0:1786100559.270426:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960657920:0@lo:400:kworker.0 00000100:00100000:2.0:1786100559.270449:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960657536:0@lo:400:kworker.0 00000100:00100000:0.0:1786100559.270614:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960657280 00000100:00100000:0.0:1786100559.270619:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960657280 00000100:00100000:0.0:1786100559.270674:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1786100559.270683:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:3308:x1872861960657280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100559.270723:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:3308:x1872861960657280:12345-0@lo:400:kworker.0 Request processed in 42us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100559.270729:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1786100559.270766:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960657280:0@lo:400:kworker.0 00000100:00100000:3.0:1786100559.780982:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786100559.781011:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960658048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100559.781079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100559.781167:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960658176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100559.781193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100559.781265:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960658048 00000100:00100000:1.0:1786100559.781277:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960658048 00000100:00100000:2.0:1786100559.781298:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960658176 00000100:00100000:2.0:1786100559.781308:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960658176 00000100:00100000:1.0:1786100559.781408:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786100559.781422:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1872861960658048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100559.781465:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100559.781554:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1872861960658048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100559.781561:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786100559.781580:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786100559.781587:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960658176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786100559.781609:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100559.781639:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960658176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100559.781645:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1786100559.783289:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429ac380 x1872861960658176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100559.783316:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960658176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100559.783335:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960658048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100560.009137:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100560.013863:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941749376 00000100:00100000:0.0:1786100560.013884:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941749376 00000100:00100000:0.0:1786100560.014064:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 251 00000100:00100000:0.0:1786100560.014076:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+11:5592:x1872861941749376:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786100560.014099:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100560.014136:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0f7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2ecc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100560.014193:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0f7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ecc expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100560.014205:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0f7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ecc expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100560.014224:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb000, rc 0) 00000100:00100000:0.0:1786100560.014314:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+12:5592:x1872861941749376:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 240us (5192us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100560.014322:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 251 00000100:00100000:2.0:1786100560.019954:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100560.020070:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941749504 00000100:00100000:1.0:1786100560.020081:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941749504 00000100:00100000:1.0:1786100560.020416:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 252 00000100:00100000:1.0:1786100560.020429:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+12:5592:x1872861941749504:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100560.020859:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+12:5592:x1872861941749504:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 432us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100560.020880:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 252 00000100:00100000:3.0:1786100560.033882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100560.034096:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941749632 00000100:00100000:0.0:1786100560.034108:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941749632 00000100:00100000:0.0:1786100560.034397:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 253 00000100:00100000:0.0:1786100560.034410:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+12:5592:x1872861941749632:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100560.035986:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+12:5592:x1872861941749632:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 1567us (2108us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100560.036000:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 253 00010000:00010000:1.0:1786100560.038161:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100560.047978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100560.048464:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941749760 00000100:00100000:1.0:1786100560.048478:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941749760 00000100:00100000:1.0:1786100560.049490:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 254 00000100:00100000:1.0:1786100560.049512:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+12:9966:x1872861941749760:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786100560.050014:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+12:9966:x1872861941749760:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 501us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100560.050024:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 254 00000100:00100000:2.0:1786100560.061818:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100560.062385:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941749888 00000100:00100000:0.0:1786100560.062398:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941749888 00000100:00100000:0.0:1786100560.062469:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 255 00000100:00100000:0.0:1786100560.062480:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6ac01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+12:9966:x1872861941749888:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786100560.063473:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6ac01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+12:9966:x1872861941749888:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 985us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100560.063487:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 255 00000100:00100000:3.0:1786100560.070109:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100560.074484:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941750016 00000100:00100000:2.0:1786100560.074830:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941750016 00000100:00100000:2.0:1786100560.074926:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 256 00000100:00100000:2.0:1786100560.074939:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+12:5592:x1872861941750016:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786100560.074962:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100560.074984:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0f86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2ed3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100560.075023:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0f86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ed3 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100560.075035:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0f86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ed3 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100560.075046:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0b200, rc 0) 00000100:00100000:2.0:1786100560.075137:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:5592:x1872861941750016:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 200us (5041us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100560.075154:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 256 00000100:00100000:3.0:1786100560.081998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100560.082630:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941750144 00000100:00100000:0.0:1786100560.083582:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941750144 00000100:00100000:0.0:1786100560.084353:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 257 00000100:00100000:0.0:1786100560.084369:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:5592:x1872861941750144:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100560.085937:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:5592:x1872861941750144:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 1560us (3943us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100560.085951:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 257 00000100:00100000:3.0:1786100560.091944:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100560.092043:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941750272 00000100:00100000:2.0:1786100560.092056:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941750272 00000100:00100000:2.0:1786100560.092122:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 258 00000100:00100000:2.0:1786100560.092135:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:5592:x1872861941750272:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100560.093536:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:5592:x1872861941750272:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 1393us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100560.093551:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 258 00000100:00100000:3.0:1786100560.107970:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100560.110032:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941750400 00000100:00100000:0.0:1786100560.110053:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941750400 00000100:00100000:0.0:1786100560.110329:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 259 00000100:00100000:0.0:1786100560.110343:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:9969:x1872861941750400:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786100560.110690:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:9969:x1872861941750400:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 350us (2735us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100560.110706:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 259 00000100:00100000:3.0:1786100560.115402:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100560.116255:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941750528 00000100:00100000:2.0:1786100560.116269:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941750528 00000100:00100000:2.0:1786100560.116510:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 260 00000100:00100000:2.0:1786100560.116523:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:9969:x1872861941750528:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786100560.116870:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:9969:x1872861941750528:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 348us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100560.116879:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 260 10000000:01000000:2.0:1786100560.296682:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786100560.296693:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c7f9ee000 from 7 10000000:01000000:2.0:1786100560.296699:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786100560.296760:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100560.296774:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100560.296788:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100560.296820:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960658304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786100560.296916:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100560.297275:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960658304 00000100:00100000:0.0:1786100560.297285:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960658304 00000100:00100000:0.0:1786100560.297338:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1786100560.297349:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+16:5840:x1872861960658304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786100560.297366:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100560.297381:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbb200/0x5564f2c20ac0f94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0f8d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100560.297419:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbb200/0x5564f2c20ac0f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0f8d expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100560.297430:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbbb200/0x5564f2c20ac0f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0f8d expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100560.297440:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb200, rc 0) 00000100:00100000:0.0:1786100560.297493:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960658304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100560.297501:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1786100560.297775:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74940900 going to sleep for 11 seconds 00000100:00100000:2.0:1786100560.297801:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960658304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786100560.297818:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100560.297828:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100560.297895:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960658432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100560.297928:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100560.297959:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74940900 going to sleep for 11 seconds 00000100:00100000:1.0:1786100560.298040:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960658432 00000100:00100000:1.0:1786100560.298044:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960658432 00000100:00100000:1.0:1786100560.298083:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1786100560.298092:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960658432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100560.298705:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960658432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 612us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100560.298714:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1786100560.299107:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960658432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100560.299165:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960658560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100560.299217:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100560.299251:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74940900 going to sleep for 11 seconds 00000100:00100000:0.0:1786100560.299314:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960658560 00000100:00100000:0.0:1786100560.299320:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960658560 00000100:00100000:0.0:1786100560.299359:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1786100560.299367:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960658560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100560.299783:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960658560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 415us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100560.299799:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1786100560.299958:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960658560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100560.302356:0:11691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:11691:1872861960658688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100560.303227:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100560.303286:0:11691:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74940600 going to sleep for 11 seconds 00000100:00100000:0.0:1786100560.303676:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960658688 00000100:00100000:0.0:1786100560.303686:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960658688 00000100:00100000:0.0:1786100560.303799:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1786100560.303811:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:11691:x1872861960658688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100560.304107:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:11691:x1872861960658688:12345-0@lo:502:llog_process_th.0 Request processed in 298us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100560.304115:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1786100560.304226:0:11691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:11691:1872861960658688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786100560.304270:0:11691:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786100560.304281:0:11691:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100560.304284:0:11691:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1786100560.304290:0:11691:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a3c7f9ee000 00000020:00000080:2.0:1786100560.304293:0:11691:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786100560.304431:0:11691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:11691:1872861960658816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100560.304498:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100560.313450:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960658816 00000100:00100000:2.0:1786100560.313780:0:11691:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74940600 going to sleep for 11 seconds 00000100:00100000:3.0:1786100560.316880:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960658816 00000100:00100000:3.0:1786100560.317003:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1786100560.317279:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:11691:x1872861960658816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100560.317610:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:11691:x1872861960658816:12345-0@lo:502:llog_process_th.0 Request processed in 596us (13109us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100560.317630:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1786100560.319599:0:11691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:11691:1872861960658816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786100560.319690:0:11691:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100560.319700:0:11691:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100560.319704:0:11691:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1786100560.319708:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1786100560.319900:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1786100560.319919:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786100560.319931:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100560.319944:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100560.319955:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786100560.319976:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c6e163000 from 7 10000000:01000000:3.0:1786100560.319981:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786100560.320039:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100560.320049:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100560.320060:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100560.320086:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960658944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786100560.320173:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100560.320219:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323600 going to sleep for 11 seconds 00000100:00100000:2.0:1786100560.320473:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960658944 00000100:00100000:2.0:1786100560.320537:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960658944 00000100:00100000:2.0:1786100560.320698:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1786100560.320709:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:5840:x1872861960658944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786100560.320725:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100560.320740:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa0a200/0x5564f2c20ac0fa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0f9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100560.320768:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa0a200/0x5564f2c20ac0fa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0f9b expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100560.320781:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa0a200/0x5564f2c20ac0fa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0f9b expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100560.320807:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0a200, rc 0) 00000100:00100000:2.0:1786100560.320854:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960658944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100560.320860:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1786100560.321434:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960658944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100560.321453:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100560.321463:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100560.321880:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960659072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786100560.321928:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100560.321993:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323600 going to sleep for 11 seconds 00000100:00100000:1.0:1786100560.322006:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960659072 00000100:00100000:1.0:1786100560.322160:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960659072 00000100:00100000:1.0:1786100560.322231:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1786100560.322242:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960659072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100560.323613:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960659072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1368us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100560.323624:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1786100560.323727:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960659072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786100560.323786:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960659200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786100560.323853:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100560.323894:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323600 going to sleep for 11 seconds 00000100:00100000:2.0:1786100560.323968:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960659200 00000100:00100000:2.0:1786100560.323975:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960659200 00000100:00100000:2.0:1786100560.324031:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1786100560.324041:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960659200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100560.324266:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960659200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100560.324274:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1786100560.324448:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960659200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786100560.329396:0:11693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:11693:1872861960659328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100560.329717:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100560.329772:0:11693:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786100560.329862:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960659328 00000100:00100000:2.0:1786100560.329872:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960659328 00000100:00100000:2.0:1786100560.329926:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1786100560.329938:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:11693:x1872861960659328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100560.330239:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:11693:x1872861960659328:12345-0@lo:502:llog_process_th.0 Request processed in 302us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100560.330247:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1786100560.330422:0:11693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:11693:1872861960659328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786100560.330462:0:11693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786100560.330474:0:11693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786100560.330476:0:11693:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1786100560.330690:0:11693:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a3c6e163000 00000020:00000080:3.0:1786100560.330694:0:11693:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1786100560.331006:0:11693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:11693:1872861960659456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100560.331234:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100560.331278:0:11693:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786100560.332155:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960659456 00000100:00100000:1.0:1786100560.332165:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960659456 00000100:00100000:1.0:1786100560.332225:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1786100560.332235:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:11693:x1872861960659456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786100560.333134:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:11693:x1872861960659456:12345-0@lo:502:llog_process_th.0 Request processed in 896us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100560.333154:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1786100560.333257:0:11693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:11693:1872861960659456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786100560.333301:0:11693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786100560.333311:0:11693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786100560.333314:0:11693:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1786100560.333319:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1786100560.333755:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1786100560.333779:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786100560.333791:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100560.333804:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100560.333816:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786100560.333819:0:5840:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c47abb000 from 7 10000000:01000000:1.0:1786100560.333822:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786100560.333860:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100560.333868:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100560.333879:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100560.333905:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960659584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786100560.333955:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100560.333994:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67480 going to sleep for 11 seconds 00000100:00100000:1.0:1786100560.334243:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960659584 00000100:00100000:1.0:1786100560.334260:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960659584 00000100:00100000:1.0:1786100560.334307:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1786100560.334316:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:5840:x1872861960659584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786100560.334328:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100560.334342:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c62386800/0x5564f2c20ac0fb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac0fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100560.334370:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62386800/0x5564f2c20ac0fb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac0fa9 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100560.334471:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c62386800/0x5564f2c20ac0fb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac0fa9 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100560.334549:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386800, rc 0) 00000100:00100000:1.0:1786100560.334958:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960659584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 642us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100560.334965:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1786100560.335137:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960659584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786100560.335165:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100560.335174:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100560.335261:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960659712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100560.335300:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100560.335857:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74940900 going to sleep for 11 seconds 00000100:00100000:1.0:1786100560.335948:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960659712 00000100:00100000:1.0:1786100560.335954:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960659712 00000100:00100000:1.0:1786100560.336124:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1786100560.336135:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960659712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100560.337165:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960659712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1023us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100560.337179:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1786100560.337367:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960659712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100560.337632:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960659840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100560.340263:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100560.340425:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74940900 going to sleep for 11 seconds 00000100:00100000:3.0:1786100560.340632:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960659840 00000100:00100000:3.0:1786100560.340642:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960659840 00000100:00100000:3.0:1786100560.340919:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1786100560.340940:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960659840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786100560.341354:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:5840:x1872861960659840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 415us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100560.341363:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1786100560.341629:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28d1ade7-51d1-4427-9c4d-d62141c5468b:5840:1872861960659840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786100560.344840:0:11695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:11695:1872861960659968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786100560.344954:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100560.345270:0:11695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67480 going to sleep for 11 seconds 00000100:00100000:3.0:1786100560.345331:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960659968 00000100:00100000:3.0:1786100560.345340:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960659968 00000100:00100000:3.0:1786100560.345407:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1786100560.345418:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:11695:x1872861960659968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100560.346182:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:11695:x1872861960659968:12345-0@lo:502:llog_process_th.0 Request processed in 761us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100560.346193:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1786100560.346584:0:11695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:11695:1872861960659968:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786100560.346642:0:11695:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786100560.346669:0:11695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100560.346672:0:11695:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1786100560.346683:0:11695:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a3c47abb000 00000020:00000080:1.0:1786100560.346686:0:11695:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1786100560.346804:0:11695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:11695:1872861960660096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786100560.346863:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100560.346892:0:11695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6029a840 going to sleep for 11 seconds 00000100:00100000:3.0:1786100560.347191:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960660096 00000100:00100000:3.0:1786100560.347198:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960660096 00000100:00100000:3.0:1786100560.347241:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1786100560.347251:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:11695:x1872861960660096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100560.347586:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:11695:x1872861960660096:12345-0@lo:502:llog_process_th.0 Request processed in 336us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100560.347594:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1786100560.347890:0:11695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28d1ade7-51d1-4427-9c4d-d62141c5468b:11695:1872861960660096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786100560.347926:0:11695:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786100560.347934:0:11695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100560.347936:0:11695:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1786100560.347941:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000040:00080000:0.0:1786100560.353702:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:3.0:1786100560.360086:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1786100560.360208:0:5840:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786100560.360223:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100560.360238:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100561.061029:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786100561.381506:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1786100561.546082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100561.546163:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100561.546203:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100561.546647:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941750784 00000100:00100000:2.0:1786100561.546691:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941750784 00000100:00100000:2.0:1786100561.546774:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 106 00000100:00100000:2.0:1786100561.546789:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+5:2351:x1872861941750784:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100561.546883:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+5:2351:x1872861941750784:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 99us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100561.546892:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 106 00000100:00080000:3.0:1786100561.546973:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100561.547218:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941750912 00000100:00100000:0.0:1786100561.547223:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941750912 00000100:00100000:0.0:1786100561.547280:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:0.0:1786100561.547288:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2352:x1872861941750912:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100561.547319:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2352:x1872861941750912:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 33us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100561.547326:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:1.0:1786100561.547467:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941750656 00000100:00100000:1.0:1786100561.547472:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941750656 00000100:00100000:1.0:1786100561.547590:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 276 00000100:00100000:1.0:1786100561.547599:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941750656:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100561.547630:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941750656:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 33us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100561.547636:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 276 00000100:00080000:2.0:1786100561.548192:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786100561.550455:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100561.550978:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941751040 00000100:00100000:1.0:1786100561.550990:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941751040 00000100:00100000:1.0:1786100561.551126:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 107 00000100:00100000:1.0:1786100561.551152:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941751040:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100561.551261:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941751040:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 125us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100561.551287:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 107 00000100:00080000:2.0:1786100561.551339:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786100562.085382:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786100562.928185:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1786100563.109020:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100564.136742:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100564.388992:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960660608:0@lo:400:kworker.0 00000100:00100000:3.0:1786100564.389060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100564.389143:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786100564.389149:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960660480:0@lo:400:kworker.0 00000100:00100000:3.0:1786100564.389175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100564.389207:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960660608 00000100:00100000:3.0:1786100564.389214:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960660608 00000100:00100000:3.0:1786100564.389265:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786100564.389274:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960660608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100564.389323:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960660608:12345-0@lo:400:kworker.0 Request processed in 49us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100564.389330:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786100564.389352:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960660480 00000100:00100000:3.0:1786100564.389356:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960660480 00000100:00100000:3.0:1786100564.389386:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1786100564.389396:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960660480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100564.389430:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960660352:0@lo:400:kworker.0 00000100:00100000:3.0:1786100564.389434:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960660480:12345-0@lo:400:kworker.0 Request processed in 37us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100564.389451:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1786100564.389482:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786100564.389488:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786100564.389524:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100564.389532:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960660480:0@lo:400:kworker.0 00000100:00100000:0.0:1786100564.389568:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960660864:0@lo:400:kworker.0 00010000:00080000:3.0:1786100564.389577:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c451e7800 x1872861960660608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100564.389593:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960660608:0@lo:400:kworker.0 00000100:00100000:0.0:1786100564.389605:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100564.389683:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960660352 00000100:00100000:3.0:1786100564.389690:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960660352 00000100:00100000:0.0:1786100564.389696:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786100564.389709:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960660224:0@lo:400:kworker.0 00000100:00100000:3.0:1786100564.389732:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1786100564.389750:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960660352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100564.389760:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100564.389796:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960660736:0@lo:400:kworker.0 00000100:00100000:3.0:1786100564.389822:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960660352:12345-0@lo:400:kworker.0 Request processed in 78us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100564.389834:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1786100564.389835:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100564.389863:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960660736 00000100:00100000:3.0:1786100564.389868:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960660736 00000100:00100000:0.0:1786100564.389889:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960660352:0@lo:400:kworker.0 00000100:00100000:3.0:1786100564.389908:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1786100564.389919:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960660736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100564.389943:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960660864 00000100:00100000:0.0:1786100564.389950:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960660864 00000100:00100000:3.0:1786100564.389974:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960660736:12345-0@lo:400:kworker.0 Request processed in 56us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100564.389982:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1786100564.390011:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786100564.390017:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100564.390017:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1786100564.390035:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960660864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100564.390093:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960660864:12345-0@lo:400:kworker.0 Request processed in 62us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100564.390102:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786100564.390125:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960660224 00000100:00100000:1.0:1786100564.390133:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960660224 00000100:00100000:0.0:1786100564.390151:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960660736:0@lo:400:kworker.0 00000100:00100000:0.0:1786100564.390169:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1786100564.390175:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a3c459e9500, transno 4294967300 00000100:00100000:1.0:1786100564.390185:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1786100564.390193:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960660864:0@lo:400:kworker.0 00000100:00100000:1.0:1786100564.390199:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960660224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100564.390256:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960660224:12345-0@lo:400:kworker.0 Request processed in 62us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100564.390265:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1786100564.390338:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960660224:0@lo:400:kworker.0 00000100:00100000:3.0:1786100564.901295:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960660992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100564.901365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100564.901456:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960661120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100564.901531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100564.903223:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960660992 00000100:00100000:3.0:1786100564.903236:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960660992 00000100:00100000:3.0:1786100564.903288:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960661120 00000100:00100000:3.0:1786100564.903292:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960661120 00000100:00100000:3.0:1786100564.903311:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1786100564.903320:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960660992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786100564.903369:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100564.903444:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960660992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100564.903453:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1786100564.903470:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786100564.903477:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960661120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786100564.903495:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100564.903535:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960661120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100564.903541:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1786100564.903709:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429afb80 x1872861960660992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100564.903730:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960660992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100564.903768:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960661120:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786100565.158048:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100566.180876:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100566.668215:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100566.668252:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100566.668288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100566.668324:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100566.668404:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941751296 00000100:00100000:1.0:1786100566.668414:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941751296 00000100:00100000:1.0:1786100566.668468:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941751552 00000100:00100000:1.0:1786100566.668471:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941751552 00000100:00100000:1.0:1786100566.668493:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 111 00000100:00100000:1.0:1786100566.668502:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:2353:x1872861941751296:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100566.668566:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:2353:x1872861941751296:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 65us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100566.668572:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 111 00000100:00100000:1.0:1786100566.668589:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 112 00000100:00100000:1.0:1786100566.668595:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941751552:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100566.668631:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941751552:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 35us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100566.668637:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 112 00000100:00100000:2.0:1786100566.668832:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941751168 00000100:00100000:2.0:1786100566.668837:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941751168 00000100:00100000:2.0:1786100566.668873:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 278 00000100:00100000:2.0:1786100566.668879:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2353:x1872861941751168:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100566.668906:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2353:x1872861941751168:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 27us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100566.668922:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 278 00000100:00080000:0.0:1786100566.669245:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100566.669406:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941751424 00000100:00100000:3.0:1786100566.669411:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941751424 00000100:00100000:3.0:1786100566.669496:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00100000:3.0:1786100566.669505:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:2353:x1872861941751424:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100566.669548:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:2353:x1872861941751424:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 45us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100566.669554:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00080000:0.0:1786100566.669594:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786100567.206071:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100568.229031:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100569.260067:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100569.512564:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786100569.512635:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786100569.512717:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960661376:0@lo:400:kworker.0 00000100:00100000:3.0:1786100569.512805:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100569.514574:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960661376 00000100:00100000:2.0:1786100569.514588:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960661376 00000100:00100000:2.0:1786100569.514689:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1786100569.514701:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960661376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100569.514792:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960661376:12345-0@lo:400:kworker.0 Request processed in 92us (1986us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100569.514800:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1786100569.514854:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960661376:0@lo:400:kworker.0 00000100:00100000:0.0:1786100569.516672:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960661248:0@lo:400:kworker.0 00000100:00100000:0.0:1786100569.516744:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100569.517358:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960661504:0@lo:400:kworker.0 00000100:00100000:0.0:1786100569.517392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100569.517425:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786100569.517430:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960661632:0@lo:400:kworker.0 00000100:00100000:0.0:1786100569.517453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100569.517481:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960661632 00000100:00100000:0.0:1786100569.517487:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960661632 00000100:00100000:0.0:1786100569.517540:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786100569.517549:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960661632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100569.517595:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960661632:12345-0@lo:400:kworker.0 Request processed in 47us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100569.517602:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1786100569.517632:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1786100569.517679:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429aea00 x1872861960661632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100569.517693:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960661632:0@lo:400:kworker.0 00000100:00100000:0.0:1786100569.517719:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960661888:0@lo:400:kworker.0 00000100:00100000:0.0:1786100569.517742:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100569.517761:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786100569.517766:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960661760:0@lo:400:kworker.0 00000100:00100000:0.0:1786100569.517800:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100569.517823:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960661888 00000100:00100000:0.0:1786100569.517826:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960661888 00000100:00100000:0.0:1786100569.518101:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786100569.518110:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960661888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100569.518149:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960661888:12345-0@lo:400:kworker.0 Request processed in 41us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100569.518155:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1786100569.518169:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786100569.518188:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960661888:0@lo:400:kworker.0 00000100:00100000:2.0:1786100569.518306:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960661248 00000100:00100000:2.0:1786100569.518311:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960661248 00000100:00100000:2.0:1786100569.518347:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1786100569.518355:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960661248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100569.518394:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960661248:12345-0@lo:400:kworker.0 Request processed in 41us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100569.518400:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1786100569.518440:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960661504 00000100:00100000:2.0:1786100569.518444:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960661504 00000100:00100000:2.0:1786100569.518470:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960661760 00000100:00100000:2.0:1786100569.518473:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960661760 00000100:00100000:2.0:1786100569.518491:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1786100569.518497:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960661504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100569.518534:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960661504:12345-0@lo:400:kworker.0 Request processed in 37us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100569.518540:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1786100569.518562:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1786100569.518568:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960661760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100569.518599:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960661760:12345-0@lo:400:kworker.0 Request processed in 31us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100569.518604:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1786100569.518632:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100569.518670:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960661504:0@lo:400:kworker.0 00000100:00100000:2.0:1786100569.518704:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960661760:0@lo:400:kworker.0 00000100:00100000:2.0:1786100569.518713:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960661248:0@lo:400:kworker.0 00000100:00100000:3.0:1786100570.022275:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960662144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100570.022339:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100570.022413:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786100570.022419:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960662016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100570.022452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100570.022522:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960662144 00000100:00100000:2.0:1786100570.022529:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960662144 00000100:00100000:2.0:1786100570.022568:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960662016 00000100:00100000:2.0:1786100570.022571:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960662016 00000100:00100000:2.0:1786100570.022583:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786100570.022591:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960662144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786100570.022703:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100570.022749:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960662144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100570.022756:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786100570.022772:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1786100570.022777:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960662016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786100570.022793:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100570.022814:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960662016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100570.022819:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1786100570.022856:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429ac380 x1872861960662016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100570.022885:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960662016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786100570.022897:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960662144:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786100570.277918:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100571.300871:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786100571.622028:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1786100571.786916:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100571.787004:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100571.787039:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100571.787093:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100571.787138:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941751808 00000100:00100000:2.0:1786100571.787147:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941751808 00000100:00100000:2.0:1786100571.787208:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941752064 00000100:00100000:2.0:1786100571.787211:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941752064 00000100:00100000:2.0:1786100571.787249:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:2.0:1786100571.787259:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941751808:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100571.787335:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941751808:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 75us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100571.787343:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:2.0:1786100571.787362:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00100000:2.0:1786100571.787370:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+5:2354:x1872861941752064:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100571.787396:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+5:2354:x1872861941752064:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 27us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100571.787403:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00080000:2.0:1786100571.787518:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100571.789470:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941751936 00000100:00100000:0.0:1786100571.789483:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941751936 00000100:00100000:0.0:1786100571.789561:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 67 00000100:00100000:0.0:1786100571.789572:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941751936:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100571.789740:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941751936:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 70us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100571.789748:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 67 00000100:00080000:2.0:1786100571.790756:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786100571.791751:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941751680 00000100:00100000:1.0:1786100571.791762:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941751680 00000100:00100000:1.0:1786100571.791882:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 280 00000100:00100000:1.0:1786100571.791893:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2354:x1872861941751680:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100571.791981:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2354:x1872861941751680:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 89us (5073us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100571.791988:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 280 00010000:00010000:2.0:1786100572.329881:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100573.352677:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100574.372826:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100574.630245:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960662656:0@lo:400:kworker.0 00000100:00100000:0.0:1786100574.630318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100574.630387:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786100574.630394:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960662528:0@lo:400:kworker.0 00000100:00100000:0.0:1786100574.630420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100574.630450:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960662656 00000100:00100000:0.0:1786100574.630457:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960662656 00000100:00100000:0.0:1786100574.630506:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786100574.630515:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960662656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100574.630574:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960662656:12345-0@lo:400:kworker.0 Request processed in 59us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100574.630581:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1786100574.630622:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c45165500 x1872861960662656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100574.630637:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960662656:0@lo:400:kworker.0 00000100:00100000:2.0:1786100574.630783:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960662272:0@lo:400:kworker.0 00000100:00100000:2.0:1786100574.630825:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100574.630859:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960662784:0@lo:400:kworker.0 00000100:00100000:2.0:1786100574.630882:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100574.630903:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1786100574.630909:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960662400:0@lo:400:kworker.0 00000100:00100000:2.0:1786100574.630931:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100574.630948:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960662912:0@lo:400:kworker.0 00000100:00100000:2.0:1786100574.630968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100574.630995:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960662528 00000100:00100000:2.0:1786100574.630999:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960662528 00000100:00100000:2.0:1786100574.631022:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960662784 00000100:00100000:2.0:1786100574.631025:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960662784 00000100:00100000:2.0:1786100574.631036:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960662400 00000100:00100000:2.0:1786100574.631038:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960662400 00000100:00100000:2.0:1786100574.631050:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1786100574.631057:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960662528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100574.631111:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960662528:12345-0@lo:400:kworker.0 Request processed in 54us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100574.631118:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1786100574.631131:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1786100574.631140:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960662784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100574.631172:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960662784:12345-0@lo:400:kworker.0 Request processed in 35us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100574.631178:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1786100574.631189:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1786100574.631195:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960662400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100574.631233:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960662400:12345-0@lo:400:kworker.0 Request processed in 38us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100574.631238:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1786100574.631254:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786100574.631259:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786100574.631281:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960662400:0@lo:400:kworker.0 00000100:00100000:2.0:1786100574.631290:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960662784:0@lo:400:kworker.0 00000100:00100000:0.0:1786100574.632228:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960662272 00000100:00100000:0.0:1786100574.632237:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960662272 00000100:00100000:0.0:1786100574.632281:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1786100574.632289:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960662272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100574.632366:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960662272:12345-0@lo:400:kworker.0 Request processed in 77us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100574.632373:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1786100574.632413:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960662912 00000100:00100000:0.0:1786100574.632419:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960662912 00000100:00100000:0.0:1786100574.632460:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1786100574.632466:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960662912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100574.632494:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960662912:12345-0@lo:400:kworker.0 Request processed in 29us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100574.632499:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1786100574.632537:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960662528:0@lo:400:kworker.0 00000100:00100000:1.0:1786100574.632620:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960662912:0@lo:400:kworker.0 00000100:00100000:1.0:1786100574.632629:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960662272:0@lo:400:kworker.0 00000100:00080000:3.0:1786100574.632684:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786100575.141074:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960663040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100575.141153:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100575.141232:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786100575.141239:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960663168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100575.141281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100575.141484:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960663040 00000100:00100000:1.0:1786100575.141491:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960663040 00000100:00100000:1.0:1786100575.141538:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960663168 00000100:00100000:1.0:1786100575.141541:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960663168 00000100:00100000:1.0:1786100575.141558:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1786100575.141566:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960663040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100575.141600:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100575.141677:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960663040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100575.141685:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1786100575.141702:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786100575.141708:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960663168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786100575.141727:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100575.141754:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960663168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100575.141760:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1786100575.142007:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429ad880 x1872861960663168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100575.142027:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960663168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100575.142042:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960663040:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786100575.397137:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100576.424382:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100576.908573:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100576.908616:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100576.908722:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941752320 00000100:00100000:3.0:1786100576.908731:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941752320 00000100:00100000:3.0:1786100576.908798:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:3.0:1786100576.908808:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+5:2352:x1872861941752320:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100576.908890:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+5:2352:x1872861941752320:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 83us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100576.908897:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:1.0:1786100576.909244:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941752192 00000100:00100000:1.0:1786100576.909249:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941752192 00000100:00100000:1.0:1786100576.909289:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 282 00000100:00100000:1.0:1786100576.909297:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2352:x1872861941752192:12345-192.168.206.53@tcp:400:kworker.0 00000100:00080000:2.0:1786100576.909425:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100576.909460:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2352:x1872861941752192:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 162us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100576.909468:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 282 00000100:00100000:2.0:1786100576.926589:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100576.926641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100576.926746:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941752448 00000100:00100000:0.0:1786100576.926756:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941752448 00000100:00100000:0.0:1786100576.926832:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:0.0:1786100576.926847:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+5:2350:x1872861941752448:12345-192.168.206.53@tcp:9:kworker.0 00000020:00000080:0.0:1786100576.926877:0:9414:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0eec 00000100:00080000:0.0:1786100576.926886:0:9414:0:(import.c:65:import_set_state_nolock()) ffff9a3b42767800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786100576.926924:0:9414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1786100576.927189:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+2:2350:x1872861941752448:12345-192.168.206.53@tcp:9:kworker.0 Request processed in 347us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100576.927197:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00010000:00010000:0.0:1786100576.927218:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786100576.927544:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786100576.928640:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941752576 00000100:00100000:3.0:1786100576.928675:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941752576 00000100:00100000:3.0:1786100576.928753:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 122 00000100:00100000:3.0:1786100576.928763:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941752576:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100576.928838:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941752576:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 78us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100576.928846:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 122 00000100:00080000:2.0:1786100576.929444:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786100577.448818:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786100578.271110:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2a93440-3d3b-4616-8388-e39125c10990 00000020:00000080:3.0:1786100578.271118:0:7635:0:(genops.c:906:class_export_put()) final put ffff9a3b42764000/d2a93440-3d3b-4616-8388-e39125c10990 00000020:00000080:1.0:1786100578.271188:0:467:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3b42764000/d2a93440-3d3b-4616-8388-e39125c10990 for lustre-OST0001 00000020:00000080:1.0:1786100578.271235:0:467:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3b42767800 for lustre-OST0001 00010000:00010000:0.0:1786100578.468854:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100579.493024:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100579.750975:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960663680:0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751121:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960663424:0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751161:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100579.751208:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960663936:0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751231:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100579.751260:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786100579.751266:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960663296:0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100579.751328:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960663808:0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751349:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100579.751371:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960663552:0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751393:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100579.751424:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960663424 00000100:00100000:0.0:1786100579.751431:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960663424 00000100:00100000:0.0:1786100579.751469:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960663808 00000100:00100000:0.0:1786100579.751472:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960663808 00000100:00100000:0.0:1786100579.751493:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960663552 00000100:00100000:0.0:1786100579.751496:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960663552 00000100:00100000:0.0:1786100579.751511:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1786100579.751518:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960663424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751566:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960663424:12345-0@lo:400:kworker.0 Request processed in 47us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100579.751573:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1786100579.751588:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1786100579.751594:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960663808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751619:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960663808:12345-0@lo:400:kworker.0 Request processed in 26us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100579.751624:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1786100579.751634:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1786100579.751640:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960663552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751697:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960663552:12345-0@lo:400:kworker.0 Request processed in 57us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100579.751703:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1786100579.751731:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960663936 00000100:00100000:0.0:1786100579.751735:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960663936 00000100:00100000:0.0:1786100579.751757:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786100579.751764:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960663936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751793:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960663936:12345-0@lo:400:kworker.0 Request processed in 30us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100579.751799:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786100579.751814:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960663296 00000100:00100000:0.0:1786100579.751817:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960663296 00000100:00100000:0.0:1786100579.751839:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1786100579.751844:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960663296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751871:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960663296:12345-0@lo:400:kworker.0 Request processed in 26us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100579.751876:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:0.0:1786100579.751907:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786100579.751912:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100579.751934:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960663296:0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751946:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960663808:0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751953:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960663424:0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751961:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960663936:0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.751995:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960663552:0@lo:400:kworker.0 00000100:00100000:1.0:1786100579.752211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100579.752278:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960663680 00000100:00100000:0.0:1786100579.752283:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960663680 00000100:00100000:0.0:1786100579.752324:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786100579.752332:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960663680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100579.752375:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960663680:12345-0@lo:400:kworker.0 Request processed in 44us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100579.752382:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1786100579.752408:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429ae680 x1872861960663680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100579.752418:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960663680:0@lo:400:kworker.0 00000100:00080000:2.0:1786100579.752484:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786100580.260798:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786100580.260820:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960664064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100580.260883:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100580.261064:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960664064 00000100:00100000:1.0:1786100580.261071:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960664064 00000100:00100000:1.0:1786100580.261113:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786100580.261122:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960664064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100580.261156:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100580.261199:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960664064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100580.261207:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786100580.261233:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960664192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100580.261257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100580.261298:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960664064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100580.261335:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960664192 00000100:00100000:1.0:1786100580.261339:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960664192 00000100:00100000:1.0:1786100580.261359:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786100580.261375:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960664192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786100580.261401:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100580.261432:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960664192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100580.261438:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1786100580.261463:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429ae680 x1872861960664192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100580.261477:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960664192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786100580.517307:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100581.543290:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786100581.862285:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1786100582.037224:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100582.037270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100582.037299:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100582.037327:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941752832 00000100:00100000:2.0:1786100582.037336:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941752832 00000100:00100000:2.0:1786100582.037396:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941752960 00000100:00100000:2.0:1786100582.037399:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941752960 00000100:00100000:2.0:1786100582.037428:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 126 00000100:00100000:2.0:1786100582.037441:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:2352:x1872861941752832:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100582.037517:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:2352:x1872861941752832:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 80us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100582.037533:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 126 00000100:00100000:2.0:1786100582.037554:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 127 00000100:00100000:2.0:1786100582.037563:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941752960:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100582.037596:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2351:x1872861941752960:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 35us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100582.037603:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 127 00000100:00080000:2.0:1786100582.037622:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100582.038174:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941752704 00000100:00100000:1.0:1786100582.038180:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941752704 00000100:00100000:1.0:1786100582.038216:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 284 00000100:00100000:1.0:1786100582.038224:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941752704:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100582.042915:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941752704:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 4680us (5632us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100582.042929:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 284 00000001:02000400:2.0:1786100582.054316:0:11861:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 07:03:00 (1786100580) 00010000:00010000:0.0:1786100582.564882:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100583.588842:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100584.028300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100584.031988:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941753088 00000100:00100000:0.0:1786100584.032002:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941753088 00000100:00100000:0.0:1786100584.032336:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:0.0:1786100584.032348:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:10238:x1872861941753088:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786100584.032369:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100584.032422:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbac00/0x5564f2c20ac0fb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2eda expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.032487:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac0fbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.032501:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac0fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.032514:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac0fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100584.032737:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786100584.032741:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786100584.032852:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac0fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.032878:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbac00/0x5564f2c20ac0fb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2eda expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.032897:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac0fbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2eda expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.032906:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:0.0:1786100584.032910:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786100584.032913:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbbc00, rc 0) 00000100:00100000:0.0:1786100584.032985:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:10238:x1872861941753088:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 639us (4695us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100584.032993:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00080000:2.0:1786100584.041139:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100584.054441:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100584.055301:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941753216 00000100:00100000:2.0:1786100584.055312:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941753216 00000100:00100000:2.0:1786100584.055375:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:2.0:1786100584.055386:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:10239:x1872861941753216:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786100584.055406:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100584.055426:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0fc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2ee1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100584.055488:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0fcc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100584.055502:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0fcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100584.055513:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0fcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100584.055546:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac0fd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100584.055554:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac0fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100584.055560:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac0fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.059548:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbac00/0x5564f2c20ac0fda lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.059570:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbac00/0x5564f2c20ac0fda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.059581:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbac00/0x5564f2c20ac0fda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100584.064499:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1786100584.064509:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100584.064719:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbac00/0x5564f2c20ac0fda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.064739:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0fcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.064758:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0fcc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.064766:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0fcc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.064784:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100584.066107:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0fcc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.066123:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0fcc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.066447:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:1.0:1786100584.066451:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100584.066457:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0fcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.066464:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac0fcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.066481:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac0fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.066487:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac0fd3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.066492:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac0fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.066497:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0b400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100584.066500:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac0fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.066505:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac0fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.066528:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a3c58043200) 00010000:00010000:1.0:1786100584.066531:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100584.066534:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac0fd3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.066540:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac0fd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.066588:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac0fc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ee1 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.066602:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbac00/0x5564f2c20ac0fda lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ee1 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100584.066609:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a3c433df100) 00010000:00010000:1.0:1786100584.066611:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100584.066613:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbac00, rc 0) 00000100:00100000:1.0:1786100584.066797:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+7:10239:x1872861941753216:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 11403us (12356us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100584.066806:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:2.0:1786100584.074327:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100584.074412:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941753472 00000100:00100000:0.0:1786100584.074422:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941753472 00000100:00100000:0.0:1786100584.074496:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:0.0:1786100584.074507:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:10239:x1872861941753472:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786100584.074529:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100584.074550:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac0fe1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2ee8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.074622:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0fe8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.074636:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.074647:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.074735:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0fef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.074752:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0fef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.074760:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0fef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.075725:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0ff6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.075738:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076117:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100584.076411:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1786100584.076634:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076643:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0fe8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076682:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0fe8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076689:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbae00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100584.076693:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0fe8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076701:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0fe8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076715:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a3c433df100) 00010000:00010000:0.0:1786100584.076718:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100584.076722:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0fe8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076729:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac0fe8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076742:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0fef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076758:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0fef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076774:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0fef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076779:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbba00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100584.076782:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0fef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076799:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0fef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076808:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a3c433df600) 00010000:00010000:0.0:1786100584.076811:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100584.076814:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0fef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.076820:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac0fef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.077625:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac0fe1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ee8 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.077644:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ee8 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100584.077675:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df900) 00010000:00010000:0.0:1786100584.077677:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100584.077680:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb600, rc 0) 00000100:00100000:0.0:1786100584.077748:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+9:10239:x1872861941753472:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 3242us (3430us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1786100584.077767:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:2.0:1786100584.089183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100584.089383:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941753600 00000100:00100000:3.0:1786100584.089394:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941753600 00000100:00100000:3.0:1786100584.089452:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:3.0:1786100584.089463:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+9:10239:x1872861941753600:12345-192.168.206.53@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1786100584.089572:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+9:10239:x1872861941753600:12345-192.168.206.53@tcp:59:lhsmtool_posix.0 Request processed in 111us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100584.089595:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 35 00010000:00010000:0.0:1786100584.618265:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100584.869958:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960664320:0@lo:400:kworker.0 00000100:00100000:2.0:1786100584.870039:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100584.870086:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c4736b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960664832:0@lo:400:kworker.0 00000100:00100000:2.0:1786100584.870113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100584.870166:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960664320 00000100:00100000:2.0:1786100584.870174:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960664320 00000100:00100000:2.0:1786100584.870212:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1786100584.870220:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960664320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100584.870263:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960664320:12345-0@lo:400:kworker.0 Request processed in 44us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100584.870270:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1786100584.870315:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960664320:0@lo:400:kworker.0 00000100:00100000:2.0:1786100584.870350:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c47369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960664576:0@lo:400:kworker.0 00000100:00100000:2.0:1786100584.870374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100584.870405:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786100584.870413:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c4736a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960664704:0@lo:400:kworker.0 00000100:00100000:2.0:1786100584.870438:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100584.870465:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960664832 00000100:00100000:2.0:1786100584.870468:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960664832 00000100:00100000:2.0:1786100584.870503:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960664576 00000100:00100000:2.0:1786100584.870507:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960664576 00000100:00100000:2.0:1786100584.870528:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1786100584.870534:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960664832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100584.870569:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960664832:12345-0@lo:400:kworker.0 Request processed in 35us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100584.870576:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1786100584.870587:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1786100584.870592:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960664576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100584.870618:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960664576:12345-0@lo:400:kworker.0 Request processed in 25us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100584.870623:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1786100584.870637:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960664704 00000100:00100000:2.0:1786100584.870640:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960664704 00000100:00100000:2.0:1786100584.870678:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786100584.870684:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960664704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100584.870708:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960664704:12345-0@lo:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100584.870714:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1786100584.870727:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786100584.870730:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100584.872067:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c47369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960664448:0@lo:400:kworker.0 00000100:00100000:2.0:1786100584.872920:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c4736b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960664832:0@lo:400:kworker.0 00000100:00100000:3.0:1786100584.877269:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100584.877324:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c4736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960664960:0@lo:400:kworker.0 00000100:00100000:3.0:1786100584.877359:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100584.877415:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960664448 00000100:00100000:3.0:1786100584.877422:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960664448 00000100:00100000:3.0:1786100584.877469:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1786100584.877479:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c4736b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960664448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100584.877532:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c4736b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960664448:12345-0@lo:400:kworker.0 Request processed in 54us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100584.877539:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1786100584.877583:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c47369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960664448:0@lo:400:kworker.0 00000100:00100000:0.0:1786100584.881625:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960664960 00000100:00100000:0.0:1786100584.881636:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960664960 00000100:00100000:0.0:1786100584.881730:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786100584.881740:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960664960:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1786100584.883069:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c4736a680 x1872861960664704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786100600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100584.883086:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c4736a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960664704:0@lo:400:kworker.0 00000100:00080000:2.0:1786100584.883102:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786100584.883289:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c47369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960664576:0@lo:400:kworker.0 00000100:00100000:0.0:1786100584.884025:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960664960:12345-0@lo:400:kworker.0 Request processed in 2284us (6662us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100584.884035:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1786100584.884243:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c4736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960664960:0@lo:400:kworker.0 00000040:00080000:0.0:1786100584.934340:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1786100585.380915:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960665216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100585.380980:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100585.381045:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786100585.381052:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960665088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100585.381074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100585.381101:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960665216 00000100:00100000:1.0:1786100585.381108:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960665216 00000100:00100000:1.0:1786100585.381153:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960665088 00000100:00100000:1.0:1786100585.381156:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960665088 00000100:00100000:1.0:1786100585.381168:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786100585.381176:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960665216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100585.381205:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100585.381244:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960665216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100585.381251:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786100585.381266:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786100585.381272:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960665088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786100585.381288:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100585.381312:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960665088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100585.381318:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1786100585.381573:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b429ae680 x1872861960665088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100585.381590:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960665088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100585.381601:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960665216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786100585.640237:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100585.990445:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100585.990545:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941753728 00000100:00100000:3.0:1786100585.990563:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941753728 00000100:00100000:3.0:1786100585.990618:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:3.0:1786100585.990627:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e02b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+9:10281:x1872861941753728:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100585.990668:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100585.990689:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1004 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2eef expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.990748:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac100b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.990762:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac100b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.990781:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac100b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.990796:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1012 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.990803:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.990808:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991065:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac100b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991074:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac100b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991081:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac100b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991088:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100585.991093:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac100b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991100:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac100b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991113:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:3.0:1786100585.991116:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100585.991120:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac100b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991134:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac100b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991147:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991153:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1012 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991159:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1012 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991164:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98e00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100585.991168:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1012 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991174:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1012 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991182:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a3c454ab600) 00010000:00010000:3.0:1786100585.991184:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100585.991187:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1012 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991193:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1012 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991232:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1004 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2eef expref: 10 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991255:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:3.0:1786100585.991258:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100585.991262:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1004 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2eef expref: 10 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100585.991272:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99a00, rc 0) 00000100:00100000:3.0:1786100585.991342:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e02b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+9:10281:x1872861941753728:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 715us (907us total) trans 0 rc 301/301 00000100:00100000:3.0:1786100585.991349:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:2.0:1786100586.002710:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100586.002804:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941753984 00000100:00100000:0.0:1786100586.002814:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941753984 00000100:00100000:0.0:1786100586.002881:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:0.0:1786100586.002891:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e02a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+9:10281:x1872861941753984:12345-192.168.206.53@tcp:36:lfs.0 00010000:00010000:0.0:1786100586.002945:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100586.002971:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac0fbe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2eda expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.002988:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:0.0:1786100586.003009:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786100586.003254:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac1019 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.003268:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac1019 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.003278:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac1019 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.003296:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1020 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.003303:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1020 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.003310:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1020 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100586.004277:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1786100586.004290:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac1019 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.004297:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac1019 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.004304:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac1019 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.004309:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100586.004313:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac1019 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.004320:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac1019 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.004332:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c433dfb00) 00010000:00010000:0.0:1786100586.004335:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100586.004339:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac1019 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.004355:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac1019 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786100586.004372:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ec59885 reply state 00000000c1224cd6 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1020 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100586.004380:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786100586.004477:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e02a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+10:10281:x1872861941753984:12345-192.168.206.53@tcp:36:lfs.0 Request processed in 1586us (1773us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1786100586.004486:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00080000:2.0:1786100586.004917:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786100586.010392:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1020 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.010407:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1020 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.010414:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1020 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.010420:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbba00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100586.010424:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1020 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.010431:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1020 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.010447:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a3c433dfd00) 00010000:00010000:2.0:1786100586.010450:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100586.010454:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1020 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.010468:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1020 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100586.104114:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100586.104297:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941754112 00000100:00100000:3.0:1786100586.104308:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941754112 00000100:00100000:3.0:1786100586.104438:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:3.0:1786100586.104456:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e02b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+9:10289:x1872861941754112:12345-192.168.206.53@tcp:101:lctl.0 00010000:00010000:3.0:1786100586.104491:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100586.104527:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1027 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2ef6 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100586.104646:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac102e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100586.104721:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac102e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100586.104738:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac102e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100586.104869:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1786100586.104874:0:9953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100586.104919:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac102e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.104945:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1027 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ef6 expref: 11 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.104962:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac102e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ef6 expref: 10 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.104971:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454ab600) 00010000:00010000:2.0:1786100586.104973:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786100586.104977:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98e00, rc 0) 00000100:00100000:2.0:1786100586.105048:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e02b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+10:10289:x1872861941754112:12345-192.168.206.53@tcp:101:lctl.0 Request processed in 601us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100586.105056:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:3.0:1786100586.196760:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100586.197313:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941754240 00000100:00100000:0.0:1786100586.197326:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941754240 00000100:00100000:0.0:1786100586.197396:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:0.0:1786100586.197407:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+10:10296:x1872861941754240:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1786100586.197428:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100586.197449:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac1035 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2efd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.197518:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac103c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.197531:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac103c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.197547:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac103c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.197562:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1043 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.197581:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1043 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.197592:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1043 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.198182:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac104a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.198192:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac104a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.198200:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac104a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100586.198236:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1786100586.198239:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786100586.198760:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac104a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.198774:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac103c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.198780:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac103c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.198787:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac103c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.198793:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100586.198797:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac103c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.198814:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac103c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.198953:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454ab600) 00010000:00010000:0.0:1786100586.198957:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100586.198961:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac103c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.198967:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac103c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.198980:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1043 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.198985:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1043 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.199022:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1043 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.199027:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbae00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100586.199030:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1043 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.199035:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1043 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.199042:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a3c433dfb00) 00010000:00010000:0.0:1786100586.199044:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100586.199047:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1043 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.199062:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1043 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.199908:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac1035 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2efd expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.199924:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac104a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2efd expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.199935:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:0.0:1786100586.199938:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786100586.199940:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb800, rc 0) 00000100:00100000:0.0:1786100586.200143:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+11:10296:x1872861941754240:12345-192.168.206.53@tcp:101:bash.0 Request processed in 2615us (3266us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100586.200155:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:3.0:1786100586.208955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100586.209135:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941754496 00000100:00100000:1.0:1786100586.209145:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941754496 00000100:00100000:1.0:1786100586.209199:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:1.0:1786100586.209209:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c4736b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+11:10296:x1872861941754496:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:1.0:1786100586.209228:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100586.209249:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1051 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f04 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.209405:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1058 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.209419:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1058 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.209430:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1058 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.209484:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac105f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.209492:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac105f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.209499:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac105f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786100586.210635:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1786100586.211063:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1066 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.211075:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1066 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.211085:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1066 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.211166:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1058 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.211185:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1058 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.211192:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1058 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.211199:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100586.211203:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1058 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.211211:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1058 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.211223:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:1.0:1786100586.211226:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100586.211230:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1058 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.211236:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1058 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786100586.211249:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e40f0530 reply state 00000000fcbda22a transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac105f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100586.211258:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786100586.211289:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1051 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f04 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.211302:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1066 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f04 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.211319:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1400) 00010000:00010000:1.0:1786100586.211321:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786100586.211324:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62387c00, rc 0) 00000100:00100000:1.0:1786100586.211485:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c4736b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+14:10296:x1872861941754496:12345-192.168.206.53@tcp:101:bash.0 Request processed in 2277us (2537us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1786100586.211494:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 40 00010000:00010000:0.0:1786100586.215338:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac105f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.215354:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac105f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.215362:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac105f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.215369:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100586.215373:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac105f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.215381:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac105f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.215408:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c461b1700) 00010000:00010000:0.0:1786100586.215412:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100586.215416:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac105f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.215422:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac105f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100586.217143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100586.217521:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941754624 00000100:00100000:2.0:1786100586.217531:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941754624 00000100:00100000:2.0:1786100586.217586:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:2.0:1786100586.217593:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1872861941754624:12345-192.168.206.53@tcp:8:bash.0 00010000:00080000:2.0:1786100586.217626:0:6684:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:2.0:1786100586.217695:0:6684:0:(genops.c:1406:class_connect()) connect: client d2a93440-3d3b-4616-8388-e39125c10990, cookie 0x5564f2c20ac1074 00002000:00100000:2.0:1786100586.217717:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d2a93440-3d3b-4616-8388-e39125c10990/ffff9a3b42767000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786100586.217728:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786100586.218236:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786100586.218267:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9a3b42760800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786100586.218330:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2350:x1872861941754624:12345-192.168.206.53@tcp:8:bash.0 Request processed in 735us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100586.218339:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:2.0:1786100586.222953:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100586.223046:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941754752 00000100:00100000:0.0:1786100586.223056:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941754752 00000100:00100000:0.0:1786100586.223127:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:0.0:1786100586.223138:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:0:x1872861941754752:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1786100586.223155:0:9414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100586.223177:0:9414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac107b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f0b expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786100586.223203:0:9414:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786100586.223221:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:0.0:1786100586.223225:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100586.223234:0:9414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac107b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f0b expref: 7 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.223253:0:9414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac107b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f0b expref: 7 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.223266:0:9414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb400, rc 0) 00000100:00100000:0.0:1786100586.223323:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:0:x1872861941754752:12345-192.168.206.53@tcp:101:bash.0 Request processed in 187us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100586.223343:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00080000:2.0:1786100586.225515:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786100586.226214:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100586.226465:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941754880 00000100:00100000:0.0:1786100586.226473:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941754880 00000100:00100000:0.0:1786100586.226526:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:0.0:1786100586.226535:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+7:10296:x1872861941754880:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1786100586.226559:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100586.226575:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f12 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.226604:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac107b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f0b expref: 8 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.226612:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100586.226616:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100586.226621:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.226731:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac107b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f0b expref: 8 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.226745:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac107b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f0b expref: 8 pid: 9414 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100586.226758:0:6686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45166680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6686:1872861960665344:192.168.206.53@tcp:104: 00000100:00100000:1.0:1786100586.230203:0:6686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c49296540 going to sleep for 11 seconds 00000100:00100000:1.0:1786100586.236139:0:6686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45166680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6686:1872861960665344:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100586.236177:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.236207:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbae00, rc 0) 00000100:00100000:1.0:1786100586.236263:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:10296:x1872861941754880:12345-192.168.206.53@tcp:101:bash.0 Request processed in 9728us (10051us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100586.236272:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:3.0:1786100586.236882:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100586.237542:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941755008 00000100:00100000:0.0:1786100586.237564:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941755008 00010000:00010000:0.0:1786100586.237602:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac107b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f0b expref: 8 pid: 9414 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100586.237781:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:0.0:1786100586.237792:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941755008:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100586.237806:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100586.237827:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac107b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f0b expref: 8 pid: 9414 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.237841:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac107b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f0b expref: 8 pid: 9414 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.237864:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac107b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f0b expref: 8 pid: 9414 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.237888:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100586.237893:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100586.237901:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.237910:0:11178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.237944:0:11178:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100586.237971:0:11178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45167800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11178:1872861960665472:192.168.206.53@tcp:105: 00000100:00100000:0.0:1786100586.238150:0:11178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c49296180 going to sleep for 11 seconds 00000100:00100000:0.0:1786100586.246620:0:11178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45167800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11178:1872861960665472:192.168.206.53@tcp:105: 00010000:00010000:0.0:1786100586.246695:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100586.246766:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941755008:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 8974us (9893us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100586.246777:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:3.0:1786100586.249085:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100586.249349:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941755264 00000100:00100000:0.0:1786100586.249366:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941755264 00000100:00100000:0.0:1786100586.249444:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:0.0:1786100586.249455:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+13:10296:x1872861941755264:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:0.0:1786100586.249825:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+14:10296:x1872861941755264:12345-192.168.206.53@tcp:35:bash.0 Request processed in 371us (752us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1786100586.249833:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:2.0:1786100586.386464:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100586.387085:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941755520 00000100:00100000:1.0:1786100586.387097:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941755520 00000100:00100000:1.0:1786100586.387193:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:1.0:1786100586.387204:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e02b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+14:10306:x1872861941755520:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100586.387230:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100586.387250:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f19 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100586.387352:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1786100586.387479:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1089 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f19 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.387506:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454ab600) 00010000:00010000:1.0:1786100586.387509:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786100586.387514:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f19 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.387528:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386600, rc 0) 00000100:00100000:1.0:1786100586.387600:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e02b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+15:10306:x1872861941755520:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 398us (1145us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1786100586.387607:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:2.0:1786100586.391075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100586.391206:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941755776 00000100:00100000:3.0:1786100586.391217:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941755776 00000100:00100000:3.0:1786100586.391276:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:3.0:1786100586.391288:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+15:10306:x1872861941755776:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1786100586.391532:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+16:10306:x1872861941755776:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 245us (465us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1786100586.391540:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:3.0:1786100586.489509:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100586.489617:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941755904 00000100:00100000:2.0:1786100586.489627:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941755904 00000100:00100000:2.0:1786100586.489725:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:2.0:1786100586.489736:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c4736aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+16:10312:x1872861941755904:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100586.489765:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100586.489795:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac1097 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f20 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.489859:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac109e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.489873:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac109e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.489884:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac109e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100586.489940:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1786100586.489955:0:9953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100586.489986:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac109e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.490028:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac1097 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f20 expref: 18 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.490047:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac109e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f20 expref: 17 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.490055:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:2.0:1786100586.490058:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786100586.490062:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0bc00, rc 0) 00000100:00100000:2.0:1786100586.490123:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c4736aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+17:10312:x1872861941755904:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 389us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100586.490129:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:3.0:1786100586.495962:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100586.496218:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941756160 00000100:00100000:0.0:1786100586.496229:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941756160 00000100:00100000:0.0:1786100586.496287:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:0.0:1786100586.496297:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c4736bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+17:10312:x1872861941756160:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1786100586.496316:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100586.496336:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac10a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f27 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.496439:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.496468:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.496480:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100586.496492:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1786100586.496608:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac10a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f27 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.496625:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f27 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.496633:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1400) 00010000:00010000:0.0:1786100586.496636:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786100586.496640:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbbc00, rc 0) 00000100:00100000:0.0:1786100586.496726:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c4736bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+19:10312:x1872861941756160:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 430us (774us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1786100586.496734:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:3.0:1786100586.501616:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100586.506269:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100586.507232:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941756544 00000100:00100000:2.0:1786100586.507245:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941756544 00000100:00100000:2.0:1786100586.507315:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:2.0:1786100586.507326:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c4736ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+19:10312:x1872861941756544:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100586.507351:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100586.507372:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac10ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f2e expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.507478:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac10c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.507492:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac10c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.507520:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac10c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100586.507533:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1786100586.507702:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac10ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f2e expref: 22 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.507721:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac10c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f2e expref: 21 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.507729:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1400) 00010000:00010000:2.0:1786100586.507732:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786100586.507735:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0b400, rc 0) 00000100:00100000:2.0:1786100586.508173:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c4736ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+21:10312:x1872861941756544:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 666us (1728us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1786100586.508183:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:0.0:1786100586.509755:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941756288 00000100:00100000:0.0:1786100586.509767:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941756288 00000100:00100000:0.0:1786100586.509931:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:0.0:1786100586.509942:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+21:2354:x1872861941756288:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100586.509956:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100586.509979:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f27 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.510030:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1400) 00010000:00010000:0.0:1786100586.510035:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100586.510086:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+20:2354:x1872861941756288:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 146us (8480us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100586.510093:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:3.0:1786100586.515873:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100586.516694:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941756672 00000100:00100000:1.0:1786100586.516707:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941756672 00000100:00100000:1.0:1786100586.516769:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:1.0:1786100586.516780:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941756672:12345-192.168.206.53@tcp:1:lfs.0 00010000:00010000:1.0:1786100586.516839:0:9414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.516870:0:9414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.516879:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100586.516884:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786100586.516889:0:9414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.516925:0:9414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.516953:0:9414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 7 pid: 6686 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100586.516967:0:9414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9414:1872861960665600:192.168.206.53@tcp:104: 00000100:00100000:1.0:1786100586.517118:0:9414:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47aa9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786100586.523548:0:9414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9414:1872861960665600:192.168.206.53@tcp:104: 00000100:00100000:3.0:1786100586.523563:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:1.0:1786100586.523583:0:9414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100586.523688:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941756800 00000100:00100000:2.0:1786100586.523696:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941756800 00002000:00100000:2.0:1786100586.523738:0:6689:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9a3c47368380 x1872861941756800/t0(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:117/0 lens 504/0 e 0 to 0 dl 1786100597 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786100586.523747:0:6689:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c47368380 with x1872861941756800 ext(0->12) 00010000:00010000:2.0:1786100586.523755:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 8 pid: 6686 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.523768:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 8 pid: 6686 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786100586.523805:0:6689:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a3c47368380 00000100:00100000:2.0:1786100586.523836:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:2.0:1786100586.523846:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941756800:12345-192.168.206.53@tcp:4:lfs.0 00000001:00100000:3.0:1786100586.563036:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d2a93440-3d3b-4616-8388-e39125c10990 00000100:00100000:2.0:1786100586.563606:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2a93440-3d3b-4616-8388-e39125c10990+9:2352:x1872861941756800:12345-192.168.206.53@tcp:4:lfs.0 Request processed in 39755us (40041us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1786100586.563619:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00002000:00100000:2.0:1786100586.563631:0:6689:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9a3c47368380 x1872861941756800/t4294967299(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:117/0 lens 504/448 e 0 to 0 dl 1786100597 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786100586.563642:0:6689:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c47368380 with x1872861941756800 ext(0->12) 00010000:00010000:2.0:1786100586.563683:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 9 pid: 6686 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.563701:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 9 pid: 6686 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786100586.563709:0:6689:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a3c47368380 00000100:00100000:2.0:1786100586.569900:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100586.570049:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941756928 00000100:00100000:1.0:1786100586.570060:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941756928 00010000:00010000:1.0:1786100586.570101:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 9 pid: 6686 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100586.570146:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:1.0:1786100586.570156:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e029180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+9:2354:x1872861941756928:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100586.570172:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786100586.570188:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1786100586.570191:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1786100585 00002000:00010000:1.0:1786100586.570193:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1786100585 00002000:00010000:1.0:1786100586.570195:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1786100585 00010000:00010000:1.0:1786100586.570202:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 9 pid: 6686 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.570234:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 9 pid: 6686 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.570264:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1082 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f12 expref: 9 pid: 6686 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.570281:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786100586.570286:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786100586.570291:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.570301:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.570341:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100586.570405:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e029180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:2354:x1872861941756928:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 250us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100586.570413:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 36 00010000:00010000:2.0:1786100586.570416:0:9414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.570425:0:9414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.570449:0:9414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.570465:0:9414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.570472:0:9414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.570479:0:9414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100586.570483:0:9414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.570491:0:9414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.570505:0:9414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.570512:0:9414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac10cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100586.570570:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941756672:12345-192.168.206.53@tcp:1:lfs.0 Request processed in 53792us (54706us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100586.570576:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:3.0:1786100586.575763:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100586.576039:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941757184 00000100:00100000:0.0:1786100586.576050:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941757184 00000100:00100000:0.0:1786100586.576105:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:0.0:1786100586.576116:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c4736a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+20:10312:x1872861941757184:12345-192.168.206.53@tcp:35:lfs.0 00000004:00010000:0.0:1786100586.576174:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac10c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f2e expref: 20 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786100586.576435:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1786100586.576493:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1786100586.577136:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1786100586.577192:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.577208:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1066 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f04 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.577216:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.577248:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1066 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f04 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.577274:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1066 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f04 expref: 24 pid: 5844 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100586.577287:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45167800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1872861960665728:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100586.577381:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47de43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100586.582525:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100586.582597:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941757312 00000100:00100000:1.0:1786100586.582606:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941757312 00010000:00010000:1.0:1786100586.582681:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1066 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f04 expref: 25 pid: 5844 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100586.582721:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:1.0:1786100586.582732:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+25:2351:x1872861941757312:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100586.582758:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100586.582766:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1066 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f04 expref: 25 pid: 5844 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.582779:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1066 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f04 expref: 25 pid: 5844 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.582803:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1400) 00010000:00010000:1.0:1786100586.582808:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.582816:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.582823:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.582846:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100586.582894:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+25:2351:x1872861941757312:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 164us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100586.582902:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 37 00010000:00010000:0.0:1786100586.583034:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1066 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f04 expref: 24 pid: 5844 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100586.583052:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45167800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1872861960665728:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100586.583074:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.583082:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.583088:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786100586.583200:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1786100586.583388:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1786100586.583520:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45167800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1872861960665856:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786100586.583604:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100586.586539:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47de4840 going to sleep for 11 seconds 00000100:00100000:1.0:1786100586.587410:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960665856 00000100:00100000:1.0:1786100586.587422:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960665856 00000100:00100000:1.0:1786100586.587544:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786100586.587555:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1872861960665856:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786100586.587704:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1872861960665856:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 151us (4098us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100586.587712:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786100586.587918:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45167800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1872861960665856:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1786100586.588555:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1786100586.588633:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45167800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1872861960665984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786100586.588712:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100586.588745:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47de43c0 going to sleep for 11 seconds 00000100:00080000:2.0:1786100586.589186:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786100586.591062:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960665984 00000100:00100000:1.0:1786100586.591077:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960665984 00000100:00100000:1.0:1786100586.591147:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786100586.591157:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1872861960665984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786100586.591434:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1872861960665984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 277us (2720us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1786100586.591440:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786100586.591617:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45167800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1872861960665984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1786100586.591696:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1786100586.591740:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.591751:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.591759:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.591765:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100586.591769:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.591777:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.591794:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1400) 00010000:00010000:0.0:1786100586.591797:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1786100586.591802:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.591809:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786100586.591986:0:5847:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1786100586.592210:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1786100586.592220:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327834568820ns, next at 328834567015ns, rc = 0 00000001:00080000:0.0:1786100586.592238:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1786100586.592277:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1400) 00010000:00010000:0.0:1786100586.592280:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786100586.592287:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac10c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f2e expref: 28 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100586.592390:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c4736a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+27:10312:x1872861941757184:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 16276us (16639us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1786100586.592399:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00000020:00080000:0.0:1786100586.592403:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1786100586.597948:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100586.598045:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941757440 00000100:00100000:0.0:1786100586.598055:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941757440 00000100:00100000:0.0:1786100586.598117:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:0.0:1786100586.598128:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c4736a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+27:10312:x1872861941757440:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1786100586.598152:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100586.598176:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac10dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f35 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.598234:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac10dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f35 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.598249:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac10dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f35 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.598268:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:0.0:1786100586.598271:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786100586.598275:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb400, rc 0) 00000100:00100000:0.0:1786100586.598339:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c4736a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+28:10312:x1872861941757440:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 212us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100586.598360:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:2.0:1786100586.602272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100586.604346:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941757696 00000100:00100000:3.0:1786100586.604361:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941757696 00000100:00100000:3.0:1786100586.604466:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:3.0:1786100586.604478:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6af00c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+28:10312:x1872861941757696:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1786100586.604742:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6af00c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+29:10312:x1872861941757696:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 264us (2477us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1786100586.604762:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00010000:00010000:0.0:1786100586.660895:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100586.701645:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100586.701769:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941757952 00000100:00100000:2.0:1786100586.701790:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941757952 00000100:00100000:2.0:1786100586.701846:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:2.0:1786100586.701855:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+29:10322:x1872861941757952:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100586.701877:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100586.701895:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac10e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f3c expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100586.702007:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1786100586.702114:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac10e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f3c expref: 31 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.702128:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454ab600) 00010000:00010000:2.0:1786100586.702131:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786100586.702136:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac10e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f3c expref: 31 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.702148:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0a600, rc 0) 00000100:00100000:2.0:1786100586.702209:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+30:10322:x1872861941757952:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 354us (572us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1786100586.702217:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:2.0:1786100586.704701:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100586.705218:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941758080 00000100:00100000:0.0:1786100586.705228:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941758080 00000100:00100000:0.0:1786100586.708805:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:0.0:1786100586.708831:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+30:10322:x1872861941758080:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:0.0:1786100586.708911:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.708927:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.708937:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.708952:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac10f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.708958:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac10f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.708965:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac10f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.711227:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1100 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.711257:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712228:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786100586.712373:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712389:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712395:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712403:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712409:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100586.712413:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712420:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712435:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:0.0:1786100586.712438:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100586.712442:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712449:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac10f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712465:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac10f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712471:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac10f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712485:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac10f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712489:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100586.712492:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac10f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712508:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac10f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712516:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c433df700) 00010000:00010000:0.0:1786100586.712519:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100586.712522:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac10f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712527:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac10f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712545:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712551:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1100 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712557:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1100 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712562:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbe00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100586.712564:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1100 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712579:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1100 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712587:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:0.0:1786100586.712589:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100586.712592:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1100 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100586.712598:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1100 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100586.714387:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+30:10322:x1872861941758080:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 5558us (9682us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100586.714400:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:3.0:1786100586.722531:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100586.722629:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941758336 00000100:00100000:0.0:1786100586.722638:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941758336 00000100:00100000:0.0:1786100586.722735:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:0.0:1786100586.722746:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c4736a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+30:10322:x1872861941758336:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1786100586.722988:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c4736a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+31:10322:x1872861941758336:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 242us (464us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1786100586.723012:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:3.0:1786100586.817835:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100586.818063:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941758592 00000100:00100000:2.0:1786100586.818073:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941758592 00000100:00100000:2.0:1786100586.818136:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:2.0:1786100586.818147:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c4736b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+31:10325:x1872861941758592:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100586.818279:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100586.818303:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac1107 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f43 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.818394:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac110e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.818407:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac110e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.818420:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac110e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.818435:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1115 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.818441:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1115 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.818447:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1115 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.818564:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac111c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.818573:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac111c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.818580:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac111c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100586.818588:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1786100586.818837:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac110e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.818969:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac110e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.818984:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac110e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819001:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100586.819005:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac110e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819013:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac110e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819025:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:2.0:1786100586.819029:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100586.819032:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac110e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819038:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac110e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819050:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1115 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819057:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1115 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819063:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1115 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819068:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100586.819071:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1115 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819088:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1115 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819096:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c58043c00) 00010000:00010000:2.0:1786100586.819099:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100586.819101:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1115 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819107:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1115 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819154:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac1107 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f43 expref: 34 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819234:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac111c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f43 expref: 33 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100586.819241:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:2.0:1786100586.819243:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100586.819246:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0b400, rc 0) 00000100:00100000:2.0:1786100586.819364:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c4736b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+33:10325:x1872861941758592:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1219us (1537us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1786100586.819372:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:2.0:1786100586.826681:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100586.826854:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941758720 00000100:00100000:1.0:1786100586.826864:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941758720 00000100:00100000:1.0:1786100586.826922:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:1.0:1786100586.826932:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+33:10325:x1872861941758720:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:1.0:1786100586.827015:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac112a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.827032:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac112a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.827045:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac112a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.827071:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac112a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.827078:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac112a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.827086:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac112a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.827093:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100586.827097:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac112a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.827115:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac112a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.827128:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:1.0:1786100586.827131:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786100586.827135:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac112a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100586.827141:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac112a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100586.827209:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+33:10325:x1872861941758720:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 279us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100586.827217:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:3.0:1786100586.852121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100586.852238:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941758976 00000100:00100000:0.0:1786100586.852249:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941758976 00000100:00100000:0.0:1786100586.852314:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:0.0:1786100586.852325:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+33:10325:x1872861941758976:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1786100586.852558:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+34:10325:x1872861941758976:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 234us (445us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1786100586.852577:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:3.0:1786100587.151475:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100587.151522:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100587.151680:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941759232 00000100:00100000:2.0:1786100587.151691:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941759232 00000100:00100000:2.0:1786100587.151754:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941759488 00000100:00100000:2.0:1786100587.151757:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941759488 00000100:00100000:2.0:1786100587.151821:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 131 00000100:00100000:2.0:1786100587.151832:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+34:2352:x1872861941759232:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100587.151908:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+34:2352:x1872861941759232:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 77us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100587.151915:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 131 00000100:00100000:2.0:1786100587.151932:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 132 00000100:00100000:2.0:1786100587.151939:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2352:x1872861941759488:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100587.151963:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2352:x1872861941759488:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 25us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100587.151969:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 132 00000100:00080000:2.0:1786100587.151987:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100587.152530:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100587.152692:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100587.154775:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941759360 00000100:00100000:2.0:1786100587.154788:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941759360 00000100:00100000:2.0:1786100587.154882:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 74 00000100:00100000:2.0:1786100587.154893:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941759360:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100587.154970:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941759360:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 79us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100587.154978:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 74 00000100:00100000:1.0:1786100587.155780:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941759104 00000100:00100000:1.0:1786100587.155787:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941759104 00000100:00100000:1.0:1786100587.156028:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 286 00000100:00100000:1.0:1786100587.156038:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2352:x1872861941759104:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100587.156095:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2352:x1872861941759104:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 59us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100587.156103:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 286 00000100:00100000:3.0:1786100587.338736:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100587.338930:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941759744 00000100:00100000:2.0:1786100587.338939:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941759744 00000100:00100000:2.0:1786100587.339014:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:2.0:1786100587.339025:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+34:10356:x1872861941759744:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:2.0:1786100587.339044:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100587.339064:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1131 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f4a expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100587.339174:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1138 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100587.339188:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100587.339200:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100587.339211:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1786100587.339346:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1131 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f4a expref: 37 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100587.339365:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1138 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f4a expref: 36 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100587.339373:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:2.0:1786100587.339376:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100587.339379:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0a400, rc 0) 00000100:00100000:2.0:1786100587.339453:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+36:10356:x1872861941759744:12345-192.168.206.53@tcp:101:cat.0 Request processed in 430us (735us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1786100587.339460:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:3.0:1786100587.345447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100587.345587:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941759872 00000100:00100000:1.0:1786100587.345598:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941759872 00000100:00100000:1.0:1786100587.345917:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:1.0:1786100587.345929:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d74450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+36:2354:x1872861941759872:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100587.345946:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100587.345970:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1138 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f4a expref: 36 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.346016:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:1.0:1786100587.346021:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100587.346075:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d74450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+35:2354:x1872861941759872:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 149us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100587.346087:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:3.0:1786100587.352573:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100587.352703:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941760128 00000100:00100000:2.0:1786100587.352714:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941760128 00000100:00100000:2.0:1786100587.352773:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:2.0:1786100587.352783:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+35:10356:x1872861941760128:12345-192.168.206.53@tcp:35:cat.0 00000100:00100000:2.0:1786100587.353020:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+36:10356:x1872861941760128:12345-192.168.206.53@tcp:35:cat.0 Request processed in 238us (456us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1786100587.353042:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:3.0:1786100587.445387:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100587.445508:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941760384 00000100:00100000:0.0:1786100587.445526:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941760384 00000100:00100000:0.0:1786100587.445606:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:0.0:1786100587.445618:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+36:10362:x1872861941760384:12345-192.168.206.53@tcp:101:dd.0 00010000:00010000:0.0:1786100587.445645:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100587.445688:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786100587.445716:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac109e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f20 expref: 36 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.445940:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:0.0:1786100587.445946:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786100587.445963:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1146 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f51 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.446472:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.446488:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac111c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f43 expref: 36 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.446496:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.446528:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac111c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f43 expref: 36 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.446539:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac111c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f43 expref: 36 pid: 9953 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100587.446565:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45166680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960666112:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100587.446759:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47de43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100587.455312:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45166680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960666112:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100587.455343:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100587.458960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100587.459070:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941760512 00000100:00100000:1.0:1786100587.459081:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941760512 00010000:00010000:1.0:1786100587.459122:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac111c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f43 expref: 37 pid: 9953 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100587.459164:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:1.0:1786100587.459175:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+37:2351:x1872861941760512:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100587.459188:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100587.459195:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac111c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f43 expref: 37 pid: 9953 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.459208:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac111c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f43 expref: 37 pid: 9953 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.459232:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac111c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f43 expref: 37 pid: 9953 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.459247:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:1.0:1786100587.459252:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.459277:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.459285:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.459327:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786100587.459374:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.459384:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100587.459405:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+36:2351:x1872861941760512:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 231us (453us total) trans 0 rc 0/0 00000004:00200000:0.0:1786100587.459406:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:1.0:1786100587.459417:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 38 00010000:00010000:0.0:1786100587.459569:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1146 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f51 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.459585:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f51 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.459592:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:0.0:1786100587.459595:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786100587.459597:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbbc00, rc 0) 00000100:00100000:0.0:1786100587.459623:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+36:10362:x1872861941760384:12345-192.168.206.53@tcp:101:dd.0 Request processed in 14008us (14254us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1786100587.459629:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:3.0:1786100587.466083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100587.466159:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941760768 00000100:00100000:2.0:1786100587.466169:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941760768 00000100:00100000:2.0:1786100587.466229:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:2.0:1786100587.466239:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+36:10362:x1872861941760768:12345-192.168.206.53@tcp:36:dd.0 00010000:00010000:2.0:1786100587.466600:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac115b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100587.466616:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac115b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100587.466626:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac115b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786100587.467893:0:9953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1786100587.467938:0:9953:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000594e9847 reply state 00000000fdc26b28 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac115b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100587.467949:0:9953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786100587.469182:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+39:10362:x1872861941760768:12345-192.168.206.53@tcp:36:dd.0 Request processed in 2938us (3101us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1786100587.469192:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 52 00000020:00080000:2.0:1786100587.469200:0:9953:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786100587.477768:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac115b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.477785:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac115b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.477793:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac115b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.477798:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100587.477813:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac115b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.477820:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac115b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.477852:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:3.0:1786100587.477865:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100587.477870:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac115b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.477877:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac115b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.685056:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100587.879636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100587.885263:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941760896 00000100:00100000:1.0:1786100587.885278:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941760896 00000100:00100000:1.0:1786100587.887995:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:1.0:1786100587.888029:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+38:10376:x1872861941760896:12345-192.168.206.53@tcp:101:stat.0 00010000:00010000:1.0:1786100587.888057:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100587.888082:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1162 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f58 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.888160:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1169 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.888175:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1169 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.888188:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1169 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.888204:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1170 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.888231:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.888239:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.888337:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1177 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.888349:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f51 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.888356:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1177 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.888405:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f51 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100587.888422:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f51 expref: 39 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100587.888436:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960666240:192.168.206.53@tcp:104: 00000100:00100000:1.0:1786100587.888546:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47aa9300 going to sleep for 11 seconds 00000100:00100000:3.0:1786100587.892151:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100587.892378:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941761152 00000100:00100000:2.0:1786100587.892389:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941761152 00000100:00100000:2.0:1786100587.892442:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:2.0:1786100587.892452:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+40:5590:x1872861941761152:12345-192.168.206.53@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1786100587.892816:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+41:5590:x1872861941761152:12345-192.168.206.53@tcp:35:ldlm_bl.0 Request processed in 365us (677us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1786100587.892838:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:1.0:1786100587.893342:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960666240:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100587.893373:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1177 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100587.897081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100587.905574:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941761280 00000100:00100000:0.0:1786100587.905589:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941761280 00010000:00010000:0.0:1786100587.905639:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f51 expref: 41 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100587.905701:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:0.0:1786100587.905711:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e02aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+41:2351:x1872861941761280:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100587.905727:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100587.905733:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f51 expref: 41 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.905746:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f51 expref: 41 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.905771:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac114d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f51 expref: 41 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.905786:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:0.0:1786100587.905791:0:11178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1177 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.905799:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1177 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.905806:0:11178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1177 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.905844:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100587.905926:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e02aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+40:2351:x1872861941761280:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 216us (8853us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100587.905934:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 39 00010000:00010000:3.0:1786100587.906124:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1177 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906141:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1177 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100587.906193:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1786100587.906198:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786100587.906235:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1177 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906248:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1177 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906257:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1169 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906263:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1169 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906271:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1169 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906287:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387c00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100587.906292:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1169 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906299:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1169 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906309:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:3.0:1786100587.906311:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100587.906315:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1169 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906321:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1169 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906332:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906338:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1170 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906343:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1170 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906347:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100587.906350:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1170 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906355:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1170 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906373:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c461b1000) 00010000:00010000:3.0:1786100587.906375:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100587.906379:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1170 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906384:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1170 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906421:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1162 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f58 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906434:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1177 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f58 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100587.906440:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:3.0:1786100587.906442:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786100587.906444:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386400, rc 0) 00000100:00100000:3.0:1786100587.906476:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+40:10376:x1872861941760896:12345-192.168.206.53@tcp:101:stat.0 Request processed in 18464us (26849us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100587.906483:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:3.0:1786100587.966891:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100587.967007:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941761536 00000100:00100000:0.0:1786100587.967022:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941761536 00000100:00100000:0.0:1786100587.967096:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00100000:0.0:1786100587.967108:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+39:10382:x1872861941761536:12345-192.168.206.53@tcp:36:truncate.0 00010000:00010000:0.0:1786100587.967174:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100587.967202:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1177 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f58 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.967221:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:0.0:1786100587.967226:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786100587.967446:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac117e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.967460:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac117e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.967470:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac117e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786100587.968728:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1786100587.968771:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a986ff41 reply state 000000008b166f65 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac117e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100587.968782:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786100587.968964:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+41:10382:x1872861941761536:12345-192.168.206.53@tcp:36:truncate.0 Request processed in 1855us (2083us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1786100587.968973:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 54 00000020:00080000:0.0:1786100587.968995:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786100587.982851:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac117e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.982868:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac117e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.982875:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac117e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.982882:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100587.982886:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac117e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.982892:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac117e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.982909:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:0.0:1786100587.982912:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100587.982916:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac117e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100587.982923:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac117e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100588.119765:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100588.120050:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941761664 00000100:00100000:0.0:1786100588.120060:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941761664 00000100:00100000:0.0:1786100588.120133:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00100000:0.0:1786100588.120143:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+40:10396:x1872861941761664:12345-192.168.206.53@tcp:101:stat.0 00010000:00010000:0.0:1786100588.120167:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100588.120188:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1185 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f5f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120270:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac118c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120283:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac118c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120294:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac118c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120310:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1193 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120318:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120324:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120412:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac119a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120421:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac119a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120428:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac119a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100588.120460:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1786100588.120464:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786100588.120486:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac119a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120508:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac119a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120516:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac118c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120523:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac118c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120529:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac118c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120535:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100588.120539:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac118c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120546:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac118c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120557:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:0.0:1786100588.120560:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100588.120564:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac118c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120570:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac118c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120583:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120589:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1193 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120605:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1193 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120610:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbe00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100588.120613:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1193 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120619:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1193 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120626:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c433df700) 00010000:00010000:0.0:1786100588.120628:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100588.120631:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1193 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120635:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1193 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120707:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1185 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f5f expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120719:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac119a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f5f expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.120726:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:0.0:1786100588.120728:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786100588.120730:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbae00, rc 0) 00000100:00100000:0.0:1786100588.120785:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+41:10396:x1872861941761664:12345-192.168.206.53@tcp:101:stat.0 Request processed in 643us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100588.120800:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00080000:2.0:1786100588.123050:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100588.210133:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100588.210347:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941761920 00000100:00100000:1.0:1786100588.210369:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941761920 00000100:00100000:1.0:1786100588.210427:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 56 00000100:00100000:1.0:1786100588.210436:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e02bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+41:10406:x1872861941761920:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100588.210456:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100588.210476:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f66 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100588.211108:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1786100588.211356:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f66 expref: 43 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.211373:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454ab600) 00010000:00010000:1.0:1786100588.211376:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786100588.211380:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f66 expref: 43 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.211394:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386e00, rc 0) 00000100:00100000:1.0:1786100588.211463:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e02bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+42:10406:x1872861941761920:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1028us (1347us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1786100588.211471:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 56 00000100:00100000:3.0:1786100588.216099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100588.217787:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941762176 00000100:00100000:0.0:1786100588.217801:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941762176 00000100:00100000:0.0:1786100588.217854:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:0.0:1786100588.217873:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+42:10406:x1872861941762176:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1786100588.218152:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+43:10406:x1872861941762176:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 280us (2061us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1786100588.218161:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:3.0:1786100588.287748:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100588.287868:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941762432 00000100:00100000:1.0:1786100588.287880:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941762432 00000100:00100000:1.0:1786100588.287941:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 57 00000100:00100000:1.0:1786100588.287951:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+43:10412:x1872861941762432:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:1.0:1786100588.287976:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100588.288008:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f6d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.288294:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.288310:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac119a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f5f expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.288318:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.288347:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac119a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f5f expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.288359:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac119a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f5f expref: 44 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100588.288373:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960666368:192.168.206.53@tcp:104: 00000100:00100000:1.0:1786100588.288458:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47aa9780 going to sleep for 11 seconds 00000100:00100000:3.0:1786100588.300244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100588.300412:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941762560 00000100:00100000:0.0:1786100588.300422:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941762560 00010000:00010000:0.0:1786100588.300462:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac119a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f5f expref: 45 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100588.300500:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:0.0:1786100588.300510:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+45:2351:x1872861941762560:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100588.300525:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100588.300531:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac119a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f5f expref: 45 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.300556:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac119a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f5f expref: 45 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.300580:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:0.0:1786100588.300585:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.300617:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.300623:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.300642:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100588.300729:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+45:2351:x1872861941762560:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 220us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100588.300737:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 40 00010000:00010000:1.0:1786100588.301323:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac119a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f5f expref: 44 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100588.301340:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960666368:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100588.301363:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.301372:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.301390:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100588.301409:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1786100588.301567:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f6d expref: 45 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.301582:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f6d expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.301590:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:1.0:1786100588.301592:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786100588.301594:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386400, rc 0) 00000100:00100000:1.0:1786100588.301628:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+44:10412:x1872861941762432:12345-192.168.206.53@tcp:101:bash.0 Request processed in 13678us (13889us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1786100588.301635:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 57 00000100:00100000:3.0:1786100588.308733:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100588.308842:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941762816 00000100:00100000:0.0:1786100588.308853:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941762816 00000100:00100000:0.0:1786100588.308928:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:0.0:1786100588.308938:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+44:10412:x1872861941762816:12345-192.168.206.53@tcp:36:bash.0 00010000:00010000:0.0:1786100588.309372:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac11c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.309391:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac11c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.309402:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac11c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786100588.309455:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1786100588.309481:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b81a2aa reply state 000000001ea08bbb transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac11c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100588.309490:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786100588.309582:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+47:10412:x1872861941762816:12345-192.168.206.53@tcp:36:bash.0 Request processed in 645us (856us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1786100588.309606:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 58 00000020:00080000:0.0:1786100588.309617:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786100588.312004:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac11c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.312029:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac11c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.312036:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac11c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.312042:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100588.312046:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac11c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.312053:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac11c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.312069:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:3.0:1786100588.312071:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100588.312076:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac11c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.312081:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac11c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100588.318568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100588.318666:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941762944 00000100:00100000:0.0:1786100588.318675:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941762944 00000100:00100000:0.0:1786100588.318734:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:0.0:1786100588.318745:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+46:10412:x1872861941762944:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1786100588.318775:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100588.318797:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac11cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f74 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.318895:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac11d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.318910:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f6d expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.318919:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac11d2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.318964:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f6d expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.318991:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f6d expref: 47 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100588.319005:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45164380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960666496:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100588.319128:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47de4300 going to sleep for 11 seconds 00000100:00100000:2.0:1786100588.326613:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100588.326720:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941763072 00000100:00100000:1.0:1786100588.326730:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941763072 00010000:00010000:1.0:1786100588.326768:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f6d expref: 48 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100588.326812:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:1.0:1786100588.326822:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e028700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+48:2352:x1872861941763072:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100588.326837:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100588.326843:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f6d expref: 48 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.326874:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f6d expref: 48 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.326898:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:1.0:1786100588.326904:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac11d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.326914:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac11d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.326921:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac11d2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.326956:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100588.327022:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e028700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+48:2352:x1872861941763072:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 201us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100588.327029:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 41 00010000:00010000:0.0:1786100588.329728:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac11b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f6d expref: 47 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100588.329753:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45164380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960666496:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100588.329778:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac11d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.329787:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac11d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.329792:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac11d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100588.329836:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1786100588.329839:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786100588.330204:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac11d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.330243:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac11cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f74 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.330259:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac11d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f74 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.330267:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:0.0:1786100588.330271:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786100588.330274:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbba400, rc 0) 00000100:00100000:0.0:1786100588.330347:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+46:10412:x1872861941762944:12345-192.168.206.53@tcp:101:bash.0 Request processed in 11604us (11787us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100588.330357:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:2.0:1786100588.339845:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100588.340236:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941763328 00000100:00100000:0.0:1786100588.340247:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941763328 00000100:00100000:0.0:1786100588.340305:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:0.0:1786100588.340316:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6af03c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+46:10412:x1872861941763328:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:0.0:1786100588.342277:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6af03c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+47:10412:x1872861941763328:12345-192.168.206.53@tcp:35:bash.0 Request processed in 1953us (2430us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1786100588.342291:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:3.0:1786100588.442932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100588.443052:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941763584 00000100:00100000:0.0:1786100588.443062:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941763584 00000100:00100000:0.0:1786100588.443125:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:0.0:1786100588.443136:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+47:10422:x1872861941763584:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1786100588.443161:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100588.443183:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac11d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f7b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100588.443297:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1786100588.443416:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac11d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f7b expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.443432:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454ab600) 00010000:00010000:0.0:1786100588.443436:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786100588.443441:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac11d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f7b expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.443456:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbbe00, rc 0) 00000100:00100000:0.0:1786100588.443531:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+48:10422:x1872861941763584:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 396us (607us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1786100588.443563:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:3.0:1786100588.447826:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100588.447950:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941763712 00000100:00100000:1.0:1786100588.447960:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941763712 00000100:00100000:1.0:1786100588.448032:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:1.0:1786100588.448042:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+48:10422:x1872861941763712:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:1.0:1786100588.448116:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448133:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448144:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448170:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac11ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448178:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac11ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448186:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac11ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448283:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac11f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448292:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac11f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448299:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac11f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786100588.448337:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac11f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448350:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448356:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448363:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448369:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386e00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100588.448373:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448386:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448398:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:1.0:1786100588.448401:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100588.448405:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448411:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac11e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448424:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac11ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448429:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac11ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448434:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac11ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448438:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100588.448441:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac11ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448446:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac11ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448453:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c461b1c00) 00010000:00010000:1.0:1786100588.448455:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100588.448458:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac11ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448474:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac11ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448489:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac11f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448495:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac11f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448502:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac11f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448507:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100588.448510:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac11f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448515:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac11f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448522:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:1.0:1786100588.448524:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100588.448527:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac11f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.448545:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac11f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100588.448624:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+48:10422:x1872861941763712:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 583us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100588.448632:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:2.0:1786100588.452408:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100588.452567:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941763968 00000100:00100000:3.0:1786100588.452577:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941763968 00000100:00100000:3.0:1786100588.454326:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:3.0:1786100588.454342:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e02ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+48:10422:x1872861941763968:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1786100588.454822:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e02ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+49:10422:x1872861941763968:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 484us (2421us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1786100588.454843:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:0.0:1786100588.498049:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100588.498198:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941764224 00000100:00100000:1.0:1786100588.498221:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941764224 00000100:00100000:1.0:1786100588.498324:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:1.0:1786100588.498335:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+49:10425:x1872861941764224:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100588.498358:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100588.498378:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac11fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f82 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.498449:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1203 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.498462:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1203 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.498471:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1203 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.498485:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac120a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.498491:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac120a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.498497:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac120a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.498905:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1211 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.498915:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.498922:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100588.498953:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1786100588.499359:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1203 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499368:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1203 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499374:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1203 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499380:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100588.499384:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1203 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499390:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1203 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499402:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:1.0:1786100588.499405:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100588.499409:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1203 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499415:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1203 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499427:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac120a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499433:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac120a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499439:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac120a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499451:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386e00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100588.499454:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac120a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499461:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac120a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499469:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c461b1c00) 00010000:00010000:1.0:1786100588.499472:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100588.499475:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac120a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499481:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac120a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499527:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac11fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f82 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499553:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1211 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f82 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.499560:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:1.0:1786100588.499562:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786100588.499565:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62387c00, rc 0) 00000100:00100000:1.0:1786100588.500192:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+51:10425:x1872861941764224:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1856us (2149us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1786100588.500202:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:2.0:1786100588.507471:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100588.507520:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100588.507595:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941764480 00000100:00100000:0.0:1786100588.507606:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941764480 00000100:00100000:0.0:1786100588.507808:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:0.0:1786100588.507822:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+51:2352:x1872861941764480:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100588.507837:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100588.507863:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac1211 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f82 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100588.507884:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:0.0:1786100588.507890:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100588.507939:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+50:2352:x1872861941764480:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 122us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100588.507947:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:3.0:1786100588.508212:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941764352 00000100:00100000:3.0:1786100588.508218:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941764352 00000100:00100000:3.0:1786100588.508247:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:3.0:1786100588.508254:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+50:10425:x1872861941764352:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:3.0:1786100588.508305:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac121f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.508319:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac121f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.508329:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac121f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.508354:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac121f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.508361:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac121f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.508368:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac121f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.508374:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100588.508378:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac121f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.508386:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac121f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.508394:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:3.0:1786100588.508423:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786100588.508428:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac121f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100588.508434:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac121f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100588.508471:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+50:10425:x1872861941764352:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 216us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100588.508478:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:0.0:1786100588.518620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100588.519223:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941764736 00000100:00100000:3.0:1786100588.519233:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941764736 00000100:00100000:3.0:1786100588.519278:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:3.0:1786100588.519287:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+50:10425:x1872861941764736:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1786100588.519500:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+51:10425:x1872861941764736:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 212us (888us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1786100588.519509:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00000001:00080000:3.0:1786100588.538477:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967345 is committed 00000004:00080000:3.0:1786100588.538509:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1786100588.538534:0:5865:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a3c47de4840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1786100588.538539:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c45907400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c47de46c0 00000020:00080000:3.0:1786100588.538542:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c45907600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c7f52f400 00000001:00080000:3.0:1786100588.538605:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967346 is committed 00000020:00080000:1.0:1786100588.538798:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1786100588.538902:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1786100588.538978:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960666624:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786100588.539056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100588.539273:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960666624 00000100:00100000:1.0:1786100588.539280:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960666624 00000100:00100000:1.0:1786100588.539346:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786100588.539357:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1872861960666624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786100588.539382:0:6683:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1786100588.539413:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a75bb69, atime: 0x6a75bb69, ctime: 0x6a75bb69, blocks: 0x1 00010000:00010000:1.0:1786100588.539422:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1226 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.539438:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1786100588.539443:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100588.539449:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1226 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.539464:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1226 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.539473:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1226 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.539480:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1226 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.539499:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786100588.540005:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1872861960666624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 649us (947us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1786100588.540020:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1786100588.540045:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100588.540051:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1226 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.540059:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100588.540063:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1226 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.540072:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1226 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.540088:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1226 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.540094:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1226 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.540109:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100588.540111:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100588.540112:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786100588.540143:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a3c45165180/2, rc 0, transno 4294967301 00000100:00100000:1.0:1786100588.540149:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960666624:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1786100588.540270:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786100588.708866:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100588.777107:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100588.777181:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941764992 00000100:00100000:1.0:1786100588.777193:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941764992 00000100:00100000:1.0:1786100588.777254:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00100000:1.0:1786100588.777265:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+13:10443:x1872861941764992:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:1.0:1786100588.777308:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100588.777340:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac122d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f89 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.777437:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1234 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.777451:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1234 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.777462:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1234 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100588.777472:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1786100588.777604:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac122d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f89 expref: 16 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.777625:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1234 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f89 expref: 15 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.777633:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:1.0:1786100588.777636:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1786100588.777640:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386e00, rc 0) 00000100:00100000:1.0:1786100588.777756:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+15:10443:x1872861941764992:12345-192.168.206.53@tcp:101:cat.0 Request processed in 493us (659us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1786100588.777764:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00100000:3.0:1786100588.832889:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100588.833761:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941765120 00000100:00100000:1.0:1786100588.833773:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941765120 00000100:00100000:1.0:1786100588.833836:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:1.0:1786100588.833870:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+15:10444:x1872861941765120:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100588.833896:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100588.833917:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1242 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f90 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.834008:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1249 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.834022:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1249 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.834034:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1249 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100588.834231:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1786100588.834235:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100588.834300:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1249 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.834444:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1242 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f90 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.834467:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1249 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f90 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.834475:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:1.0:1786100588.834478:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100588.834481:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62387800, rc 0) 00000100:00100000:1.0:1786100588.834609:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+16:10444:x1872861941765120:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 755us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100588.834630:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:0.0:1786100588.841309:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100588.846696:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941765504 00000100:00100000:3.0:1786100588.846712:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941765504 00000100:00100000:3.0:1786100588.846792:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:3.0:1786100588.846804:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+16:10444:x1872861941765504:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1786100588.847181:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+17:10444:x1872861941765504:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 379us (5880us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1786100588.847189:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:0.0:1786100588.850488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100588.850596:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941765632 00000100:00100000:1.0:1786100588.850606:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941765632 00000100:00100000:1.0:1786100588.850691:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:1.0:1786100588.850702:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+17:10444:x1872861941765632:12345-192.168.206.53@tcp:103:lfs.0 00010000:00010000:1.0:1786100588.850719:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786100588.850744:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac11d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f74 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.850767:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1234 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f89 expref: 16 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.850781:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac10dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f35 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.850791:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c433df300) 00010000:00010000:1.0:1786100588.850802:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100588.850854:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+14:10444:x1872861941765632:12345-192.168.206.53@tcp:103:lfs.0 Request processed in 154us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100588.850863:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:0.0:1786100588.859355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100588.859571:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941765760 00000100:00100000:1.0:1786100588.859582:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941765760 00000100:00100000:1.0:1786100588.859632:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:1.0:1786100588.859641:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+14:10444:x1872861941765760:12345-192.168.206.53@tcp:58:lfs.0 00010000:00010000:1.0:1786100588.859805:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1250 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.859832:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1250 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.859844:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1250 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786100588.860466:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786100588.860645:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1786100588.860743:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1786100588.860844:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+14:10444:x1872861941765760:12345-192.168.206.53@tcp:58:lfs.0 Request processed in 1200us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100588.860854:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:0.0:1786100588.938308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100588.938616:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941765888 00000100:00100000:1.0:1786100588.938626:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941765888 00000100:00100000:1.0:1786100588.938877:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 67 00000100:00100000:1.0:1786100588.938889:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+14:10446:x1872861941765888:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100588.938910:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100588.938929:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1257 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f97 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939006:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac125e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939019:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac125e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939030:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac125e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939085:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1265 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939095:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1265 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939102:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1265 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939377:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac126c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939387:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac126c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939394:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac126c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100588.939426:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1786100588.939431:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100588.939449:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac126c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939460:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac126c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939468:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac125e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939474:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac125e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939489:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac125e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939495:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387c00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100588.939499:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac125e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939506:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac125e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939829:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:1.0:1786100588.939834:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100588.939839:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac125e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939846:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387c00/0x5564f2c20ac125e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939859:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1265 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939865:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1265 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939870:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1265 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939875:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100588.939878:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1265 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939894:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1265 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939902:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c461b1d00) 00010000:00010000:1.0:1786100588.939904:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100588.939907:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1265 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939913:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386400/0x5564f2c20ac1265 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939944:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386600/0x5564f2c20ac1257 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f97 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939957:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac126c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f97 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100588.939964:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:1.0:1786100588.939966:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100588.939968:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f800, rc 0) 00000100:00100000:1.0:1786100588.940043:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+15:10446:x1872861941765888:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1156us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100588.940051:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 67 00000040:00080000:2.0:1786100589.030315:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786100589.030323:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786100589.030373:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1786100589.030380:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786100589.030500:0:11696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6e029c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1872861960666752:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786100589.032100:0:11696:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736180 going to sleep for 11 seconds 00000100:00100000:2.0:1786100589.037895:0:11696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6e029c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1872861960666752:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786100589.042083:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100589.042766:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941766016 00000100:00100000:3.0:1786100589.042776:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941766016 00000100:00100000:3.0:1786100589.042836:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:3.0:1786100589.042848:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d2a93440-3d3b-4616-8388-e39125c10990+15:10457:x1872861941766016:12345-192.168.206.53@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1786100589.042939:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d2a93440-3d3b-4616-8388-e39125c10990+15:10457:x1872861941766016:12345-192.168.206.53@tcp:900:lhsmtool_posix.0 Request processed in 92us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100589.042946:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:0.0:1786100589.045856:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100589.048927:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941766144 00000100:00100000:1.0:1786100589.048946:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941766144 00000100:00100000:1.0:1786100589.049028:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 68 00000100:00100000:1.0:1786100589.049039:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+15:10457:x1872861941766144:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786100589.049095:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786100589.049221:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+15:10457:x1872861941766144:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 182us (3370us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100589.049229:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 68 00000100:00100000:2.0:1786100589.060603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100589.060817:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941766272 00000100:00100000:0.0:1786100589.060828:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941766272 00000100:00100000:0.0:1786100589.060906:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:0.0:1786100589.060917:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+15:10457:x1872861941766272:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786100589.061051:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1273 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061067:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1273 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061078:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1273 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061095:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac127a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061103:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac127a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061110:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac127a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061136:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1281 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061145:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061152:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100589.061306:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1786100589.061311:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786100589.061324:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061343:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1273 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061349:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1273 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061356:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1273 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061363:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100589.061367:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1273 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061374:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1273 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061386:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df900) 00010000:00010000:0.0:1786100589.061388:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100589.061392:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1273 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061398:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1273 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061410:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac127a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061417:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac127a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061422:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac127a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061435:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100589.061438:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac127a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061444:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac127a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061452:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9a3c433df700) 00010000:00010000:0.0:1786100589.061455:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100589.061457:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac127a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061463:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac127a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061476:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061483:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1281 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061488:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061493:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbe00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100589.061496:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061502:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1281 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061518:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:0.0:1786100589.061520:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100589.061523:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1281 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.061528:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1281 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100589.061882:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+15:10457:x1872861941766272:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 Request processed in 966us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100589.061891:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:0.0:1786100589.074552:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100589.075106:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941766528 00000100:00100000:1.0:1786100589.075117:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941766528 00000100:00100000:1.0:1786100589.075220:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 70 00000100:00100000:1.0:1786100589.075232:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+15:10457:x1872861941766528:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786100589.075252:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100589.075272:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1288 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2f9e expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.075368:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac128f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.075383:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac128f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.075394:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac128f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100589.075405:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1786100589.075498:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac128f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.075507:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac128f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.075514:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac128f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.075527:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100589.075545:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac128f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.075554:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac128f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.075566:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:1.0:1786100589.075569:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100589.075574:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac128f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.075580:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac128f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.075618:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1288 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f9e expref: 17 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.075640:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df900) 00010000:00010000:1.0:1786100589.075642:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786100589.075646:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1288 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f9e expref: 17 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.075683:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165e400, rc 0) 00000100:00100000:1.0:1786100589.075735:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+16:10457:x1872861941766528:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 506us (1190us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1786100589.075742:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 70 00000100:00100000:0.0:1786100589.079138:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100589.079317:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941766656 00000100:00100000:1.0:1786100589.079334:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941766656 00000100:00100000:1.0:1786100589.079737:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:1.0:1786100589.079749:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+16:10457:x1872861941766656:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786100589.079784:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786100589.079906:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+16:10457:x1872861941766656:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 154us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100589.079915:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:2.0:1786100589.087345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100589.090490:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941766912 00000100:00100000:1.0:1786100589.090505:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941766912 00000100:00100000:1.0:1786100589.090575:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00100000:1.0:1786100589.090586:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+16:10457:x1872861941766912:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786100589.090607:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100589.090610:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786100589.090635:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62387800/0x5564f2c20ac1249 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f90 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.090679:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:1.0:1786100589.090684:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786100589.090698:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac129d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2fa5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786100589.091355:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1786100589.091603:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac12a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.091617:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac12a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.091638:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac12a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.091721:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac129d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fa5 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.091737:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac12a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fa5 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.091744:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a3c461b1d00) 00010000:00010000:1.0:1786100589.091747:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786100589.091749:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165fc00, rc 0) 00000100:00100000:1.0:1786100589.091822:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+17:10457:x1872861941766912:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 1237us (4485us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1786100589.091830:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00100000:0.0:1786100589.096971:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100589.097221:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941767168 00000100:00100000:2.0:1786100589.097232:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941767168 00000100:00100000:2.0:1786100589.097324:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 73 00000100:00100000:2.0:1786100589.097334:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+17:10457:x1872861941767168:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786100589.097393:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100589.097418:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac12a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fa5 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097447:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a3c461b1d00) 00010000:00010000:2.0:1786100589.097457:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100589.097478:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac12b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097490:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac12b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097500:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac12b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097559:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac12b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa312b499 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097566:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac12b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa312b499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097572:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac12b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa312b499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097878:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac12b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097888:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac12b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097912:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac12b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097918:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100589.097923:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac12b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097936:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac12b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097946:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:2.0:1786100589.097949:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100589.097953:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac12b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097959:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac12b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097968:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac12b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa312b499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097974:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac12b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa312b499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.097996:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac12b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa312b499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.098002:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0b400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100589.098005:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac12b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa312b499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.098011:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac12b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa312b499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.098018:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa312b499 (ffff9a3c58043c00) 00010000:00010000:2.0:1786100589.098020:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100589.098023:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac12b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa312b499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.098039:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac12b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa312b499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100589.098132:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+16:10457:x1872861941767168:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 797us (1168us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786100589.098141:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 73 00000100:00100000:2.0:1786100589.100568:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100589.100696:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941767296 00000100:00100000:1.0:1786100589.100707:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941767296 00000100:00100000:1.0:1786100589.100768:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 74 00000100:00100000:1.0:1786100589.100778:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e02a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+16:10457:x1872861941767296:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786100589.100799:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100589.101075:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2fac expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.101114:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac12c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.101127:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac12c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.101145:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac12c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.101236:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fac expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.101255:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac12c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fac expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.101263:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:1.0:1786100589.101266:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786100589.101269:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f200, rc 0) 00000100:00100000:1.0:1786100589.101377:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e02a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+17:10457:x1872861941767296:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 598us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100589.101384:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 74 00000100:00100000:0.0:1786100589.128145:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100589.128213:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941767552 00000100:00100000:1.0:1786100589.128224:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941767552 00000100:00100000:1.0:1786100589.128287:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 75 00000100:00100000:1.0:1786100589.128297:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+17:10457:x1872861941767552:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786100589.128376:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.128393:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.128406:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786100589.128715:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1786100589.128725:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330371073709ns, next at 331371071384ns, rc = 0 00000004:00010000:1.0:1786100589.128801:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a0e3955 reply state 0000000065da5320 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100589.128810:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786100589.129161:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+19:10457:x1872861941767552:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 864us (1023us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1786100589.129169:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 75 00010000:00010000:2.0:1786100589.134285:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.134302:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.134310:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.134317:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100589.134321:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.134329:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.134347:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:2.0:1786100589.134350:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786100589.134355:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.134361:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100589.134500:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100589.135105:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941767680 00000100:00100000:1.0:1786100589.135115:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941767680 00000100:00100000:1.0:1786100589.136817:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:1.0:1786100589.136831:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+18:10457:x1872861941767680:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786100589.136862:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100589.136883:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac12d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2fb3 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.136944:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac12d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fb3 expref: 19 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.136961:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac12d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fb3 expref: 19 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.136993:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:1.0:1786100589.136996:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786100589.137000:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f000, rc 0) 00000100:00100000:1.0:1786100589.137077:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+19:10457:x1872861941767680:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 249us (2581us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100589.137096:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:0.0:1786100589.153086:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100589.153136:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941767808 00000100:00100000:2.0:1786100589.153146:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941767808 00000100:00100000:2.0:1786100589.153206:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:2.0:1786100589.153214:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1872861941767808:12345-192.168.206.53@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1786100589.153246:0:6684:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:2.0:1786100589.153279:0:6684:0:(genops.c:1406:class_connect()) connect: client d2a93440-3d3b-4616-8388-e39125c10990, cookie 0x5564f2c20ac12dc 00002000:00100000:2.0:1786100589.153296:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d2a93440-3d3b-4616-8388-e39125c10990/ffff9a3c45048000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786100589.153318:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786100589.153525:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786100589.153554:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9a3c4504c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786100589.153620:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2350:x1872861941767808:12345-192.168.206.53@tcp:8:lhsmtool_posix.0 Request processed in 404us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100589.153627:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:2.0:1786100589.160748:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100589.160857:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941767936 00000100:00100000:3.0:1786100589.160866:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941767936 00000100:00100000:3.0:1786100589.160931:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:3.0:1786100589.160941:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e029180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:0:x1872861941767936:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1786100589.161593:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1786100589.262382:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2a93440-3d3b-4616-8388-e39125c10990 00000001:00080000:3.0:1786100589.262402:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1786100589.262566:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e029180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:0:x1872861941767936:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 101621us (101821us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1786100589.262578:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:0.0:1786100589.274443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100589.274663:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941768192 00000100:00100000:2.0:1786100589.274673:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941768192 00000100:00100000:2.0:1786100589.274723:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:2.0:1786100589.274732:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+19:10457:x1872861941768192:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786100589.274939:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+20:10457:x1872861941768192:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 207us (510us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1786100589.274960:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:2.0:1786100589.292802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100589.293149:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941768448 00000100:00100000:1.0:1786100589.293160:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941768448 00000100:00100000:1.0:1786100589.293220:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00100000:1.0:1786100589.293229:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+20:10457:x1872861941768448:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786100589.293338:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+20:10457:x1872861941768448:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 109us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100589.293346:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00100000:1.0:1786100589.296396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100589.296475:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941768576 00000100:00100000:2.0:1786100589.296486:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941768576 00000100:00100000:2.0:1786100589.296553:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 78 00000100:00100000:2.0:1786100589.296564:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+20:10457:x1872861941768576:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786100589.296585:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100589.296604:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac12e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2fba expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.296687:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac12ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.296700:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac12ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.296711:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac12ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100589.296742:0:9953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100589.296758:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac12ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.296783:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac12e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fba expref: 22 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.296799:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac12ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fba expref: 21 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.297140:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:2.0:1786100589.297143:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786100589.297146:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0a400, rc 0) 00000100:00100000:2.0:1786100589.297213:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+21:10457:x1872861941768576:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 650us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100589.297221:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 78 00000100:00100000:0.0:1786100589.305680:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100589.305766:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941768704 00000100:00100000:3.0:1786100589.305776:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941768704 00000100:00100000:3.0:1786100589.305864:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:3.0:1786100589.305875:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2351:x1872861941768704:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786100589.305893:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100589.305928:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000458c02c3/0x5564f2c20ac12f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2fc1 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786100589.305954:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a75bb6c, blocks: 0x1 00010000:00010000:3.0:1786100589.305973:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1786100589.305988:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100589.305997:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000458c02c3/0x5564f2c20ac12f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc1 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.306018:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000458c02c3/0x5564f2c20ac12f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc1 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.306032:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99800, rc 0) 00000100:00100000:3.0:1786100589.306102:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941768704:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 229us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100589.306110:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:3.0:1786100589.311584:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100589.312069:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941768960 00000100:00100000:2.0:1786100589.312079:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941768960 00000100:00100000:0.0:1786100589.312254:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 79 00000100:00100000:0.0:1786100589.312264:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+21:10457:x1872861941768960:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786100589.312361:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+21:10457:x1872861941768960:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 98us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100589.312369:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 79 00000100:00100000:0.0:1786100589.316294:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100589.316583:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941769088 00000100:00100000:2.0:1786100589.316593:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941769088 00000100:00100000:2.0:1786100589.316678:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:2.0:1786100589.316688:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:10457:x1872861941769088:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786100589.316708:0:9414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100589.316728:0:9414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000358dff1a/0x5564f2c20ac12f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2fc8 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.316760:0:9414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000458c02c3/0x5564f2c20ac12f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc1 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.316769:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100589.316774:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100589.316779:0:9414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000358dff1a/0x5564f2c20ac12f8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc8 expref: 7 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.316833:0:9414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000458c02c3/0x5564f2c20ac12f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc1 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.316853:0:9414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000458c02c3/0x5564f2c20ac12f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc1 expref: 7 pid: 6684 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100589.316867:0:9414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9414:1872861960666880:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100589.316995:0:9414:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736900 going to sleep for 11 seconds 00000100:00100000:1.0:1786100589.321526:0:9414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9414:1872861960666880:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100589.321578:0:9414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000358dff1a/0x5564f2c20ac12f8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc8 expref: 7 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.321599:0:9414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0a800, rc 0) 00000100:00100000:1.0:1786100589.321674:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:10457:x1872861941769088:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 4988us (5390us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100589.321684:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:3.0:1786100589.329181:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100589.329900:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941769216 00000100:00100000:0.0:1786100589.329911:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941769216 00010000:00010000:0.0:1786100589.329951:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000458c02c3/0x5564f2c20ac12f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc1 expref: 7 pid: 6684 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100589.330005:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:0.0:1786100589.330016:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941769216:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100589.330031:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100589.330053:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000458c02c3/0x5564f2c20ac12f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc1 expref: 7 pid: 6684 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.330067:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000458c02c3/0x5564f2c20ac12f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc1 expref: 7 pid: 6684 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.330090:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000458c02c3/0x5564f2c20ac12f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc1 expref: 7 pid: 6684 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.330104:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100589.330108:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100589.330117:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000358dff1a/0x5564f2c20ac12f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc8 expref: 6 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.330127:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000358dff1a/0x5564f2c20ac12f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc8 expref: 6 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.330167:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000358dff1a/0x5564f2c20ac12f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc8 expref: 6 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100589.330189:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1872861960667008:192.168.206.53@tcp:105: 00000100:00100000:0.0:1786100589.330260:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ded5540 going to sleep for 11 seconds 00000100:00100000:0.0:1786100589.332909:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1872861960667008:192.168.206.53@tcp:105: 00010000:00010000:0.0:1786100589.332934:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100589.332996:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2352:x1872861941769216:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 2981us (3823us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100589.333008:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:0.0:1786100589.337649:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100589.337782:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941769344 00000100:00100000:2.0:1786100589.337792:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941769344 00002000:00100000:2.0:1786100589.337839:0:6691:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a3c7c10c700 x1872861941769344/t0(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:120/0 lens 504/0 e 0 to 0 dl 1786100600 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786100589.337849:0:6691:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c7c10c700 with x1872861941769344 ext(0->8) 00002000:00010000:2.0:1786100589.337854:0:6691:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c7c10c700 00000100:00100000:2.0:1786100589.337888:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:2.0:1786100589.337898:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2352:x1872861941769344:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786100589.338557:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941769344:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 Request processed in 658us (916us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1786100589.338565:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00002000:00100000:2.0:1786100589.338572:0:6691:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a3c7c10c700 x1872861941769344/t4294967302(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:120/0 lens 504/448 e 0 to 0 dl 1786100600 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786100589.338580:0:6691:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c7c10c700 with x1872861941769344 ext(0->8) 00002000:00010000:2.0:1786100589.338584:0:6691:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c7c10c700 00000100:00100000:3.0:1786100589.351365:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100589.353031:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941769472 00000100:00100000:0.0:1786100589.353066:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941769472 00000100:00100000:0.0:1786100589.353137:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:0.0:1786100589.353148:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+21:10457:x1872861941769472:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1786100589.400931:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1786100589.400945:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1786100589.400971:0:5865:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1786100589.401060:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:0.0:1786100589.401192:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960667136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786100589.401253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100589.401443:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+13:10457:x1872861941769472:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 Request processed in 48294us (50084us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100589.401454:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:2.0:1786100589.404075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100589.404125:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960667136 00000100:00100000:3.0:1786100589.404135:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960667136 00000100:00100000:3.0:1786100589.404192:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941769600 00000100:00100000:3.0:1786100589.404195:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941769600 00000100:00100000:3.0:1786100589.404267:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786100589.404277:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960667136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786100589.404447:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1786100589.404450:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1786100588 00002000:00010000:3.0:1786100589.404461:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786100589.404463:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1786100588 -> 1786100588 00002000:00010000:3.0:1786100589.404465:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1786100589.404538:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1872861960667136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 262us (3284us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1786100589.404546:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786100589.404563:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 30 00000100:00100000:3.0:1786100589.404570:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941769600:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1786100589.404571:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a3c7c10c000/2, rc 0, transno 4294967303 00000100:00100000:0.0:1786100589.404577:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960667136:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1786100589.407727:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1786100589.408909:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1786100589.408924:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1786100589.440266:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941769600:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 Request processed in 35686us (36186us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100589.440279:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 30 00000001:00080000:2.0:1786100589.440704:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1786100589.440720:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1786100589.442755:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100589.442939:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941769856 00000100:00100000:1.0:1786100589.442949:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941769856 00000100:00100000:1.0:1786100589.443054:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:1.0:1786100589.443064:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+13:10457:x1872861941769856:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786100589.443116:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100589.443151:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac12ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fba expref: 13 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.443176:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:1.0:1786100589.443182:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786100589.443212:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.443226:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.443235:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786100589.443482:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000deafaf53 reply state 00000000799eeade transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100589.443491:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786100589.443602:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+14:10457:x1872861941769856:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 538us (854us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1786100589.443609:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:3.0:1786100589.446965:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:3.0:1786100589.447060:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.447072:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.447079:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.447086:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100589.447090:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.447098:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.447115:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:3.0:1786100589.447127:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100589.447133:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.447140:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac12ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100589.447172:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941769984 00000100:00100000:3.0:1786100589.447182:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941769984 00000100:00100000:3.0:1786100589.447235:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:3.0:1786100589.447245:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941769984:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1786100589.447479:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1786100589.447483:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1786100588 -> 1786100587 00002000:00010000:3.0:1786100589.447486:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1786100585 00002000:00010000:3.0:1786100589.447488:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1786100588 -> 1786100587 00002000:00010000:3.0:1786100589.447491:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1786100589.447549:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:2353:x1872861941769984:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 304us (592us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1786100589.447557:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:3.0:1786100589.454043:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100589.454145:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941770240 00000100:00100000:0.0:1786100589.454155:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941770240 00000100:00100000:0.0:1786100589.454248:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 82 00000100:00100000:0.0:1786100589.454259:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+13:10457:x1872861941770240:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1786100589.454331:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.454350:0:9953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac12c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fac expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.454360:0:9953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.454394:0:9953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac12c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fac expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100589.454407:0:9953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac12c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fac expref: 13 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100589.454422:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960667264:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100589.454508:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323780 going to sleep for 11 seconds 00000100:00100000:3.0:1786100589.458118:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100589.458266:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960667264:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100589.458293:0:9953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100589.458480:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941770368 00000100:00100000:1.0:1786100589.458487:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941770368 00010000:00010000:1.0:1786100589.458522:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac12c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fac expref: 14 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100589.458564:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:1.0:1786100589.458574:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+14:2352:x1872861941770368:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100589.458588:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100589.458596:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac12c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fac expref: 14 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.458620:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac12c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fac expref: 14 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.458642:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac12c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fac expref: 14 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.458681:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:1.0:1786100589.458686:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.458695:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.458702:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.458730:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100589.458778:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+13:2352:x1872861941770368:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 206us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100589.458785:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 43 00010000:00010000:3.0:1786100589.459190:0:9953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.459198:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.459224:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.459242:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.459249:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.459255:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbae00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100589.459259:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.459267:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.459276:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:3.0:1786100589.459279:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786100589.459283:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.459289:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1306 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100589.459926:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+12:10457:x1872861941770240:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 Request processed in 5665us (6105us total) trans 0 rc -22/-22 00000100:00100000:3.0:1786100589.459935:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 82 00000100:00100000:0.0:1786100589.470060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100589.471142:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941770496 00000100:00100000:2.0:1786100589.471153:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941770496 00000100:00100000:2.0:1786100589.471278:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:2.0:1786100589.471286:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941770496:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786100589.471325:0:9414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.471343:0:9414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000358dff1a/0x5564f2c20ac12f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc8 expref: 7 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.471351:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100589.471356:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786100589.471360:0:9414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.471391:0:9414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000358dff1a/0x5564f2c20ac12f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc8 expref: 7 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.471402:0:9414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000358dff1a/0x5564f2c20ac12f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc8 expref: 7 pid: 9414 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100589.471416:0:9414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9414:1872861960667392:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100589.471499:0:9414:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786100589.477613:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100589.477722:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941770624 00000100:00100000:3.0:1786100589.477732:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941770624 00000100:00100000:1.0:1786100589.477770:0:9414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9414:1872861960667392:192.168.206.53@tcp:104: 00010000:00010000:3.0:1786100589.477772:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000358dff1a/0x5564f2c20ac12f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc8 expref: 8 pid: 9414 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.477795:0:9414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100589.477810:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:3.0:1786100589.477828:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e02aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941770624:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100589.477844:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100589.477877:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000358dff1a/0x5564f2c20ac12f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc8 expref: 8 pid: 9414 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.477891:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000358dff1a/0x5564f2c20ac12f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc8 expref: 8 pid: 9414 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.477916:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000358dff1a/0x5564f2c20ac12f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fc8 expref: 8 pid: 9414 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.477931:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786100589.477936:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786100589.477942:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.477952:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.477992:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786100589.478009:0:9414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.478027:0:9414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100589.478040:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e02aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941770624:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 214us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100589.478047:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 44 00010000:00010000:1.0:1786100589.478050:0:9414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.478058:0:9414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.478066:0:9414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.478073:0:9414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0b400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100589.478078:0:9414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.478086:0:9414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.478098:0:9414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.478105:0:9414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac130d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100589.478165:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2352:x1872861941770496:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 Request processed in 6879us (8113us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100589.478173:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:1.0:1786100589.481627:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100589.481788:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941770880 00000100:00100000:2.0:1786100589.481796:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941770880 00000100:00100000:2.0:1786100589.481856:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 83 00000100:00100000:2.0:1786100589.481866:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+12:10457:x1872861941770880:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786100589.481938:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1314 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.481954:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.481965:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.482158:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.482170:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac12d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fb3 expref: 13 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.482179:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.482211:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac12d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fb3 expref: 13 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.482225:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac12d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fb3 expref: 13 pid: 9953 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100589.482240:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960667520:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100589.482320:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736900 going to sleep for 11 seconds 00000100:00100000:0.0:1786100589.488085:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100589.488196:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941771008 00000100:00100000:3.0:1786100589.488207:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941771008 00010000:00010000:3.0:1786100589.488245:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac12d5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fb3 expref: 14 pid: 9953 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100589.488300:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:3.0:1786100589.488311:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e028700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+14:2351:x1872861941771008:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100589.488326:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100589.488333:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac12d5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fb3 expref: 14 pid: 9953 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.488345:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac12d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fb3 expref: 14 pid: 9953 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.488370:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:3.0:1786100589.488375:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.488385:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.488390:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.488411:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100589.488462:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e028700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+14:2351:x1872861941771008:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 153us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100589.488469:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 45 00010000:00010000:1.0:1786100589.488564:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac12d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fb3 expref: 13 pid: 9953 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100589.488580:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960667520:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100589.488602:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.488611:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.488616:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786100589.488838:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1786100589.489067:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1786100589.489120:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1786100589.489199:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b429adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1872861960667648:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786100589.489260:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100589.489288:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47aa9840 going to sleep for 11 seconds 00000100:00100000:1.0:1786100589.489307:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960667648 00000100:00100000:1.0:1786100589.489313:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960667648 00000100:00100000:1.0:1786100589.489343:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786100589.489351:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1872861960667648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786100589.489427:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1872861960667648:12345-0@lo:1000:mdt00_001.0 Request processed in 75us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100589.489434:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786100589.489552:0:5844:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1786100589.489558:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a3c7c10c000, transno 4294967303 00000100:00100000:1.0:1786100589.489571:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b429adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1872861960667648:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1786100589.490061:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1786100589.490114:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1872861960667776:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786100589.490146:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100589.490166:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47aa9480 going to sleep for 11 seconds 00000100:00100000:1.0:1786100589.490345:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960667776 00000100:00100000:1.0:1786100589.490351:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960667776 00000100:00100000:1.0:1786100589.490377:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786100589.490385:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1872861960667776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786100589.490540:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1872861960667776:12345-0@lo:1000:mdt00_001.0 Request processed in 155us (391us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1786100589.490546:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786100589.490582:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1872861960667776:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1786100589.490611:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490620:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490628:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490634:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100589.490645:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490676:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490692:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:1.0:1786100589.490696:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786100589.490699:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490705:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac131b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490744:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1250 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490751:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1250 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490757:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1250 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490762:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386e00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100589.490764:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1250 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490770:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1250 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490778:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:1.0:1786100589.490780:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786100589.490790:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1250 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490795:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c62386e00/0x5564f2c20ac1250 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490815:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490829:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac126c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f97 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490837:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490863:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac126c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f97 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.490877:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac126c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f97 expref: 16 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100589.490889:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960667904:192.168.206.53@tcp:104: 00000100:00100000:1.0:1786100589.490951:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47aa9480 going to sleep for 11 seconds 00000100:00100000:0.0:1786100589.493941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100589.494013:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941771136 00000100:00100000:3.0:1786100589.494024:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941771136 00010000:00010000:3.0:1786100589.494061:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac126c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f97 expref: 17 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100589.494115:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:3.0:1786100589.494125:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+17:2352:x1872861941771136:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100589.494141:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100589.494148:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac126c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f97 expref: 17 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.494163:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac126c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f97 expref: 17 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.494187:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:3.0:1786100589.494192:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.494205:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.494215:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.494237:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100589.494289:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+17:2352:x1872861941771136:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 165us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100589.494296:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 46 00010000:00010000:1.0:1786100589.494546:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac126c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2f97 expref: 16 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100589.494565:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960667904:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100589.494595:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494616:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494622:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494637:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494643:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494677:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494685:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100589.494691:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494698:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494708:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:1.0:1786100589.494711:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100589.494715:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494720:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac1322 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494731:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494745:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1314 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494751:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1314 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494758:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0b400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100589.494761:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1314 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494767:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1314 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494775:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:1.0:1786100589.494777:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786100589.494780:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1314 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100589.494785:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1314 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100589.495005:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+15:10457:x1872861941770880:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 13139us (13384us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1786100589.495014:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 83 00000020:00080000:1.0:1786100589.495018:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1786100589.495196:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786100589.495201:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786100589.495228:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1786100589.495241:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786100589.510802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100589.510902:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941771392 00000100:00100000:2.0:1786100589.510913:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941771392 00000100:00100000:2.0:1786100589.510971:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:2.0:1786100589.510991:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+15:10457:x1872861941771392:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1786100589.511606:0:5847:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1786100589.511742:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1786100589.511789:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1329 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.511806:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.511818:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.511828:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1329 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.511836:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1329 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.511843:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.511865:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786100589.511952:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+17:10457:x1872861941771392:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 961us (1157us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1786100589.511961:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00000020:00080000:2.0:1786100589.511967:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786100589.516738:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100589.516751:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1329 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.516762:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0bc00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100589.516765:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1329 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.516775:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.516794:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:2.0:1786100589.516797:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786100589.516802:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1329 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.516808:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1329 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.516827:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100589.516829:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100589.516831:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100589.733453:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786100589.787460:0:12013:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786100589.787468:0:12013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786100589.787500:0:12013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1786100589.787506:0:12013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786100589.955785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100589.955869:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941771648 00000100:00100000:3.0:1786100589.955880:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941771648 00000100:00100000:3.0:1786100589.955940:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 84 00000100:00100000:3.0:1786100589.955953:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c4736a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+17:10467:x1872861941771648:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100589.955990:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100589.956012:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1330 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2fcf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.956254:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98c00/0x5564f2c20ac1337 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.956268:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98c00/0x5564f2c20ac1337 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.956281:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98c00/0x5564f2c20ac1337 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100589.956293:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1786100589.956456:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1330 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fcf expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.956474:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98c00/0x5564f2c20ac1337 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fcf expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100589.956482:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:3.0:1786100589.956485:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786100589.956488:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98c00, rc 0) 00000100:00100000:3.0:1786100589.956556:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c4736a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+19:10467:x1872861941771648:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 607us (778us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1786100589.956573:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 84 00000100:00100000:1.0:1786100589.969134:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100589.969959:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941771776 00000100:00100000:2.0:1786100589.969970:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941771776 00000100:00100000:2.0:1786100589.970037:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00100000:2.0:1786100589.970047:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+19:10467:x1872861941771776:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:2.0:1786100589.970121:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1345 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.970138:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1345 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.970163:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1345 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.970181:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac134c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.970189:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac134c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.970194:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac134c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.970471:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1353 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.970480:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.970488:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100589.975028:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975053:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1345 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975060:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1345 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975067:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1345 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975088:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100589.975092:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1345 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975100:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1345 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975116:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:2.0:1786100589.975119:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100589.975123:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1345 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975129:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1345 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975143:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac134c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975149:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac134c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975155:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac134c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975160:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0bc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100589.975163:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac134c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975169:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac134c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975188:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c58043400) 00010000:00010000:2.0:1786100589.975191:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100589.975194:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac134c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975199:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac134c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975217:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975223:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1353 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975229:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1353 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975234:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0b400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100589.975237:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1353 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975243:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1353 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975251:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043c00) 00010000:00010000:2.0:1786100589.975253:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100589.975256:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1353 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100589.975261:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1353 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100589.975370:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+19:10467:x1872861941771776:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 5321us (6241us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100589.975381:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00100000:3.0:1786100589.994057:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960668032:0@lo:400:kworker.0 00000100:00100000:3.0:1786100589.994140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100589.994193:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960668544:0@lo:400:kworker.0 00000100:00100000:3.0:1786100589.994226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100589.994259:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786100589.994265:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960668160:0@lo:400:kworker.0 00000100:00100000:3.0:1786100589.994292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100589.994310:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960668672:0@lo:400:kworker.0 00000100:00100000:3.0:1786100589.994339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100589.994373:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960668544 00000100:00100000:3.0:1786100589.994380:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960668544 00000100:00100000:3.0:1786100589.994431:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960668160 00000100:00100000:3.0:1786100589.994434:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960668160 00000100:00100000:3.0:1786100589.994460:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1786100589.994468:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1872861960668544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100589.994527:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1872861960668544:12345-0@lo:400:kworker.0 Request processed in 58us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100589.994534:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1786100589.994550:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1786100589.994555:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960668160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100589.994581:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960668160:12345-0@lo:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100589.994586:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1786100589.994626:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960668160:0@lo:400:kworker.0 00000100:00100000:3.0:1786100589.994992:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960668544:0@lo:400:kworker.0 00000100:00100000:2.0:1786100589.995189:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960668032 00000100:00100000:2.0:1786100589.995194:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960668032 00000100:00100000:2.0:1786100589.995229:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1786100589.995236:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3305:x1872861960668032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100589.995287:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3305:x1872861960668032:12345-0@lo:400:kworker.0 Request processed in 52us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100589.995293:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1786100589.995327:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960668672 00000100:00100000:2.0:1786100589.995330:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960668672 00000100:00100000:2.0:1786100589.995357:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1786100589.995364:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1872861960668672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100589.995398:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1872861960668672:12345-0@lo:400:kworker.0 Request processed in 35us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100589.995404:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1786100589.995420:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100589.995445:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960668672:0@lo:400:kworker.0 00000100:00100000:2.0:1786100589.995462:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28d1ade7-51d1-4427-9c4d-d62141c5468b:3305:1872861960668032:0@lo:400:kworker.0 00000100:00100000:0.0:1786100589.995755:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960668416:0@lo:400:kworker.0 00000100:00100000:1.0:1786100589.995953:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960668288:0@lo:400:kworker.0 00000100:00100000:1.0:1786100589.996003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100589.996169:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100590.000762:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960668416 00000100:00100000:3.0:1786100590.000776:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960668416 00000100:00100000:3.0:1786100590.000837:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1786100590.000861:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1872861960668416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100590.000955:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1872861960668416:12345-0@lo:400:kworker.0 Request processed in 109us (4785us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100590.000963:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1786100590.001034:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960668416:0@lo:400:kworker.0 00000100:00100000:2.0:1786100590.001207:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960668288 00000100:00100000:2.0:1786100590.001212:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960668288 00000100:00100000:2.0:1786100590.001272:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1786100590.001284:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960668288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100590.001364:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960668288:12345-0@lo:400:kworker.0 Request processed in 84us (5360us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100590.001382:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1786100590.001435:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100590.001993:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960668288:0@lo:400:kworker.0 00000100:00100000:0.0:1786100590.046770:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.050082:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941772032 00000100:00100000:2.0:1786100590.050098:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941772032 00000100:00100000:2.0:1786100590.050245:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 86 00000100:00100000:2.0:1786100590.050256:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+19:10470:x1872861941772032:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100590.050276:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100590.050297:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac135a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2fd6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.050369:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1361 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.050384:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.050396:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.050412:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1368 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.050419:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.050425:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052022:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac136f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052038:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac136f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052057:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac136f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100590.052071:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1786100590.052164:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052172:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1361 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052179:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1361 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052185:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0bc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100590.052189:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1361 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052196:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1361 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052209:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:2.0:1786100590.052212:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100590.052217:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1361 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052224:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1361 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052237:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052243:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1368 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052254:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052259:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100590.052261:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052267:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1368 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052275:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c58043c00) 00010000:00010000:2.0:1786100590.052277:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100590.052280:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1368 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052286:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1368 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052333:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac135a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fd6 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052348:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac136f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fd6 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.052355:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:2.0:1786100590.052357:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100590.052360:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0a800, rc 0) 00000100:00100000:2.0:1786100590.052434:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+21:10470:x1872861941772032:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 2178us (5670us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1786100590.052452:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 86 00000100:00080000:3.0:1786100590.055298:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100590.060725:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100590.060815:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941772160 00000100:00100000:1.0:1786100590.060824:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941772160 00000100:00100000:1.0:1786100590.060894:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 87 00000100:00100000:1.0:1786100590.060904:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+21:10470:x1872861941772160:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:1.0:1786100590.060981:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac137d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.060998:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac137d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.061009:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac137d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.061034:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac137d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.061040:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac137d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.061047:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac137d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.061053:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100590.061057:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac137d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.061065:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac137d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.061095:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:1.0:1786100590.061098:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786100590.061102:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac137d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.061108:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac137d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100590.061172:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+21:10470:x1872861941772160:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 269us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100590.061180:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 87 00000100:00100000:1.0:1786100590.071743:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.072967:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941772416 00000100:00100000:2.0:1786100590.073042:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941772416 00000100:00100000:2.0:1786100590.073167:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:2.0:1786100590.073179:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6af02c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+21:10470:x1872861941772416:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:2.0:1786100590.073416:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6af02c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+22:10470:x1872861941772416:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 237us (1680us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1786100590.073424:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:0.0:1786100590.114274:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.114383:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941772672 00000100:00100000:2.0:1786100590.114395:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941772672 00000100:00100000:2.0:1786100590.114460:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 88 00000100:00100000:2.0:1786100590.114471:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+22:9999:x1872861941772672:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1786100590.114506:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100590.114533:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1384 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2fdd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.114640:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.114944:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac136f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fd6 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.114955:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.115001:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac136f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fd6 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.115029:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac136f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fd6 expref: 23 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100590.115044:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960668800:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100590.115322:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7ce9c480 going to sleep for 11 seconds 00000100:00100000:2.0:1786100590.119280:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960668800:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100590.119310:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100590.120218:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100590.120707:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941772800 00000100:00100000:3.0:1786100590.120715:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941772800 00010000:00010000:3.0:1786100590.120751:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac136f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fd6 expref: 24 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100590.120787:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:3.0:1786100590.120796:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+24:2352:x1872861941772800:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100590.120810:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100590.120816:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac136f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fd6 expref: 24 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.120829:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac136f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fd6 expref: 24 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.120910:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac136f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fd6 expref: 24 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.120940:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:3.0:1786100590.120945:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.120955:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.120962:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.121081:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100590.121132:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+23:2352:x1872861941772800:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 336us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100590.121140:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 47 00010000:00010000:2.0:1786100590.124675:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.124691:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100590.124716:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1786100590.124878:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0b400/0x5564f2c20ac1384 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fdd expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.124899:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fdd expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.124908:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:2.0:1786100590.124911:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786100590.124914:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0a600, rc 0) 00000100:00100000:2.0:1786100590.124992:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+23:9999:x1872861941772672:12345-192.168.206.53@tcp:101:bash.0 Request processed in 10523us (10727us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1786100590.125014:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 88 00000100:00100000:0.0:1786100590.136333:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100590.136420:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941773056 00000100:00100000:1.0:1786100590.136430:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941773056 00000100:00100000:1.0:1786100590.136494:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 89 00000100:00100000:1.0:1786100590.136504:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+23:9999:x1872861941773056:12345-192.168.206.53@tcp:36:bash.0 00010000:00010000:1.0:1786100590.136781:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1399 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.136797:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.136807:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786100590.136921:0:9953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1786100590.136960:0:9953:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5207d4c reply state 00000000202606c7 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100590.137050:0:9953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1786100590.137101:0:9953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1786100590.137319:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+27:9999:x1872861941773056:12345-192.168.206.53@tcp:36:bash.0 Request processed in 815us (993us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1786100590.137328:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 89 00000020:00080000:1.0:1786100590.137332:0:9953:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1786100590.140161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100590.140231:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941773184 00000100:00100000:3.0:1786100590.140241:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941773184 00000100:00100000:3.0:1786100590.140298:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 90 00000100:00100000:3.0:1786100590.140307:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+27:9999:x1872861941773184:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1786100590.140330:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100590.140350:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac13a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2fe4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.140416:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac13a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fe4 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.140432:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac13a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fe4 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.140469:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:3.0:1786100590.140473:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786100590.140476:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99c00, rc 0) 00000100:00100000:3.0:1786100590.140539:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+28:9999:x1872861941773184:12345-192.168.206.53@tcp:101:bash.0 Request processed in 232us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100590.140545:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 90 00010000:00010000:2.0:1786100590.141482:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.141493:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1399 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.141501:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1399 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.141507:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100590.141511:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1399 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.141519:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1399 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.141543:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:2.0:1786100590.141546:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100590.141550:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1399 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.141555:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1399 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100590.150190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.150287:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941773312 00000100:00100000:2.0:1786100590.150298:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941773312 00000100:00100000:2.0:1786100590.150359:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:2.0:1786100590.150370:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bf57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:9999:x1872861941773312:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1786100590.150399:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100590.150434:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac13a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2feb expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786100590.150463:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a75bb6b, atime: 0x6a75bb69, ctime: 0x6a75bb6b, blocks: 0xb 00010000:00010000:2.0:1786100590.150487:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1786100590.150492:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100590.150501:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac13a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2feb expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.150523:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac13a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2feb expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.150549:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0b400, rc 0) 00000100:00100000:2.0:1786100590.150616:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bf57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+7:9999:x1872861941773312:12345-192.168.206.53@tcp:101:bash.0 Request processed in 247us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100590.150624:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:1.0:1786100590.162090:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.162631:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941773440 00000100:00100000:2.0:1786100590.162642:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941773440 00002000:00010000:2.0:1786100590.162704:0:6689:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1786100590.162709:0:6689:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c47369f80 with x1872861941773440 ext(0->18446744073709551615) 00002000:00010000:2.0:1786100590.162719:0:6689:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c47369f80. 00000100:00100000:2.0:1786100590.162741:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:2.0:1786100590.162749:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941773440:12345-192.168.206.53@tcp:10:bash.0 00002000:00010000:2.0:1786100590.164148:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1786100590.164157:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1786100587 -> 1786100589 00002000:00010000:2.0:1786100590.164160:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1786100585 -> 1786100585 00002000:00010000:2.0:1786100590.164173:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1786100587 -> 1786100589 00002000:00010000:2.0:1786100590.164176:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1786100590.164239:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941773440:12345-192.168.206.53@tcp:10:bash.0 Request processed in 1487us (2155us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1786100590.164249:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00002000:00010000:2.0:1786100590.164254:0:6689:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1786100590.164257:0:6689:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c47369f80 with x1872861941773440 ext(0->18446744073709551615) 00002000:00010000:2.0:1786100590.164263:0:6689:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c47369f80. 00000100:00100000:0.0:1786100590.296940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.297116:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941773568 00000100:00100000:2.0:1786100590.297126:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941773568 00000100:00100000:2.0:1786100590.297193:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 91 00000100:00100000:2.0:1786100590.297205:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+27:10484:x1872861941773568:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:2.0:1786100590.297284:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.297314:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.297327:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.297346:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.297354:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.297360:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.298349:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.298364:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.298374:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100590.298419:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.298431:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.298437:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.298444:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.298450:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0bc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100590.298454:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.298462:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.298474:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:2.0:1786100590.298477:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100590.298481:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.298495:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.298509:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.298515:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.298520:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.299675:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100590.299681:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.299691:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.299706:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c58043a00) 00010000:00010000:2.0:1786100590.299709:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100590.299713:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.299720:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.299743:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.299749:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.299768:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.299774:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100590.299777:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.299783:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.299792:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:2.0:1786100590.299795:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100590.299798:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.299804:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100590.300901:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+27:10484:x1872861941773568:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 3687us (3959us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100590.300914:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 91 00000100:00100000:0.0:1786100590.386029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100590.386108:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941773824 00000100:00100000:3.0:1786100590.386119:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941773824 00000100:00100000:3.0:1786100590.386172:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 92 00000100:00100000:3.0:1786100590.386182:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+27:10487:x1872861941773824:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100590.386201:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100590.386223:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac13c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2ff2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386295:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac13ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386309:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac13ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386321:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac13ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386335:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac13d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386341:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac13d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386362:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac13d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386693:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac13d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386702:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac13d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386709:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac13d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100590.386718:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1786100590.386798:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac13ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386806:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac13ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386812:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac13ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386818:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100590.386822:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac13ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386830:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac13ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386841:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:3.0:1786100590.386844:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100590.386854:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac13ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386861:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac13ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386873:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac13d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386878:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac13d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386885:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac13d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386890:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99a00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100590.386893:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac13d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386898:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac13d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386905:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c454abf00) 00010000:00010000:3.0:1786100590.386907:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100590.386910:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac13d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386915:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac13d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386949:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac13c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ff2 expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386985:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac13d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ff2 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.386993:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:3.0:1786100590.386995:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786100590.386998:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98600, rc 0) 00000100:00100000:3.0:1786100590.387061:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+29:10487:x1872861941773824:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 880us (1039us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1786100590.387068:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 92 00000100:00100000:1.0:1786100590.390396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.390490:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941773952 00000100:00100000:2.0:1786100590.390501:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941773952 00000100:00100000:2.0:1786100590.390570:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 93 00000100:00100000:2.0:1786100590.390580:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+29:10487:x1872861941773952:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:2.0:1786100590.390642:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.390701:0:9953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fdd expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.390721:0:9953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.390755:0:9953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fdd expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.390767:0:9953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fdd expref: 29 pid: 5845 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100590.390782:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960668928:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100590.390849:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7ce9c840 going to sleep for 11 seconds 00000100:00100000:2.0:1786100590.393255:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960668928:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100590.393287:0:9953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100590.394060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100590.394144:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941774208 00000100:00100000:0.0:1786100590.394152:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941774208 00000100:00100000:0.0:1786100590.394208:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:0.0:1786100590.394219:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+30:5590:x1872861941774208:12345-192.168.206.53@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786100590.394527:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+31:5590:x1872861941774208:12345-192.168.206.53@tcp:35:ldlm_bl.0 Request processed in 309us (468us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1786100590.394536:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:1.0:1786100590.397087:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100590.397235:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941774336 00000100:00100000:3.0:1786100590.397244:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941774336 00010000:00010000:3.0:1786100590.397281:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fdd expref: 31 pid: 5845 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100590.397321:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:3.0:1786100590.397331:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+31:2351:x1872861941774336:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100590.397345:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100590.397352:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fdd expref: 31 pid: 5845 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.397366:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fdd expref: 31 pid: 5845 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.397389:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac138b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fdd expref: 31 pid: 5845 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.397422:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:3.0:1786100590.397428:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.397438:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.397445:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.397537:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100590.397593:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+30:2351:x1872861941774336:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 262us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100590.397602:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 48 00010000:00010000:2.0:1786100590.399225:0:9953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.399241:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.399274:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.399281:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.399288:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.399308:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100590.399313:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.399321:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.399336:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:2.0:1786100590.399339:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786100590.399343:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.399350:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100590.399434:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+29:10487:x1872861941773952:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 8852us (9043us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100590.399443:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 93 00000100:00100000:1.0:1786100590.402486:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100590.402578:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941774592 00000100:00100000:0.0:1786100590.402588:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941774592 00000100:00100000:0.0:1786100590.402680:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:0.0:1786100590.402692:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+29:10487:x1872861941774592:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1786100590.402899:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+30:10487:x1872861941774592:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 208us (421us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1786100590.402907:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:3.0:1786100590.501075:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960669056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100590.501142:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100590.501223:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786100590.501230:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960669184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100590.501255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100590.501342:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960669056 00000100:00100000:2.0:1786100590.501350:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960669056 00000100:00100000:2.0:1786100590.501398:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960669184 00000100:00100000:2.0:1786100590.501401:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960669184 00000100:00100000:2.0:1786100590.501430:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1786100590.501440:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872861960669056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786100590.501462:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1786100590.501507:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872861960669056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100590.501515:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1786100590.501545:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1786100590.501551:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1872861960669184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786100590.501573:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100590.501601:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1872861960669184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100590.501607:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1786100590.502045:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786100590.502085:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960669184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100590.502103:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960669056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100590.515026:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.515136:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941774848 00000100:00100000:2.0:1786100590.515146:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941774848 00000100:00100000:2.0:1786100590.515210:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 94 00000100:00100000:2.0:1786100590.515233:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+30:10498:x1872861941774848:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:2.0:1786100590.515262:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100590.515283:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c2ff9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515352:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515366:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515377:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515391:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515398:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515405:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515782:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1402 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515792:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515800:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100590.515809:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1786100590.515895:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515903:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515909:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515915:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100590.515920:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515927:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515939:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:2.0:1786100590.515942:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100590.515947:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515953:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac13f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515984:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515990:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.515995:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.516001:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0bc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100590.516004:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.516010:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.516018:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c58043a00) 00010000:00010000:2.0:1786100590.516020:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100590.516023:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.516030:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac13fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.516071:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac13ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ff9 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.516087:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1402 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ff9 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.516105:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:2.0:1786100590.516107:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100590.516110:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa0a600, rc 0) 00000100:00100000:2.0:1786100590.516180:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+32:10498:x1872861941774848:12345-192.168.206.53@tcp:101:cat.0 Request processed in 949us (1163us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1786100590.516187:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 94 00000100:00100000:1.0:1786100590.521536:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100590.521683:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941775104 00000100:00100000:0.0:1786100590.521703:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941775104 00000100:00100000:0.0:1786100590.521752:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:0.0:1786100590.521761:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+32:10498:x1872861941775104:12345-192.168.206.53@tcp:35:cat.0 00000100:00100000:0.0:1786100590.522168:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+33:10498:x1872861941775104:12345-192.168.206.53@tcp:35:cat.0 Request processed in 407us (648us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1786100590.522178:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:1.0:1786100590.545872:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.547495:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941775360 00000100:00100000:2.0:1786100590.547510:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941775360 00000100:00100000:2.0:1786100590.549075:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 95 00000100:00100000:2.0:1786100590.549098:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+33:10499:x1872861941775360:12345-192.168.206.53@tcp:36:rm.0 00010000:00010000:2.0:1786100590.549158:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1786100590.549188:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a600/0x5564f2c20ac1402 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ff9 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.549213:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac13d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ff2 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.549228:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac13a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fe4 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.549239:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:2.0:1786100590.549250:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100590.549272:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1410 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.549285:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1410 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.549307:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1410 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.549324:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1417 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.549332:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1417 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.549338:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1417 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.549929:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac141e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.549939:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac141e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.549947:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac141e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786100590.550616:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1786100590.550626:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331792974083ns, next at 332792971927ns, rc = 0 00010000:00010000:2.0:1786100590.550725:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1425 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.550737:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1425 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.550746:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1425 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.550841:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1425 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.550848:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1425 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.550854:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1425 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.550876:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786100590.550896:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac141e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.550903:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac141e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.550906:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100590.550912:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac141e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.550916:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1425 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.550921:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100590.550930:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac141e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.550930:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100590.550937:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1425 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.550942:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac141e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.550949:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1425 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.550957:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043700) 00010000:00010000:2.0:1786100590.550961:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786100590.550965:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac141e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.550982:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a3c58043700) 00010000:00010000:0.0:1786100590.550986:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786100590.550990:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1425 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.550996:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1425 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.551008:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100590.551010:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100590.551011:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100590.551043:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a800/0x5564f2c20ac141e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.551070:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1410 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.551076:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1410 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.551082:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1410 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.551087:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100590.551090:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1410 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.551096:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1410 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.551104:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:2.0:1786100590.551107:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100590.551110:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1410 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.551116:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0a400/0x5564f2c20ac1410 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100590.551126:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4093926 reply state 000000003776033a transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1417 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100590.551135:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786100590.551231:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+32:10499:x1872861941775360:12345-192.168.206.53@tcp:36:rm.0 Request processed in 2140us (5364us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1786100590.551241:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 95 00010000:00010000:0.0:1786100590.553394:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1417 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.553424:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1417 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.553431:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1417 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.553437:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0bc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100590.553441:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1417 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.553449:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1417 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.553466:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c58043a00) 00010000:00010000:0.0:1786100590.553468:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100590.553472:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1417 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.553477:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa0bc00/0x5564f2c20ac1417 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100590.631727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.631869:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941775616 00000100:00100000:2.0:1786100590.631879:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941775616 00000100:00100000:2.0:1786100590.631941:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 96 00000100:00100000:2.0:1786100590.631954:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+31:10505:x1872861941775616:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1786100590.632151:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100590.632174:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac142c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3000 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.632363:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1433 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.632378:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1433 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.632390:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1433 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.632405:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac143a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.632412:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac143a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.632419:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac143a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786100590.633428:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1786100590.633596:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1441 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.633608:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.633624:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.633688:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1433 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.633696:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1433 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.633702:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1433 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.633709:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100590.633713:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1433 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.633721:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1433 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.633734:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:2.0:1786100590.633737:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100590.633741:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1433 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.633747:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1433 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100590.637362:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1fa44dc reply state 00000000b5f3783a transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac143a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100590.637382:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786100590.637458:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac142c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3000 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.637480:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3000 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.637489:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:2.0:1786100590.637491:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100590.637495:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51fc00, rc 0) 00000100:00100000:2.0:1786100590.637577:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+34:10505:x1872861941775616:12345-192.168.206.53@tcp:101:bash.0 Request processed in 5626us (5858us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1786100590.637585:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 96 00010000:00010000:2.0:1786100590.642892:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac143a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.642911:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac143a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.642920:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac143a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.642926:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51ee00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100590.642932:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac143a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.642940:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac143a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.642959:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c58043700) 00010000:00010000:2.0:1786100590.642963:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100590.642992:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac143a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.642999:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac143a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100590.645559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100590.645998:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941775744 00000100:00100000:3.0:1786100590.646008:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941775744 00000100:00100000:3.0:1786100590.646092:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:3.0:1786100590.646115:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+7:2353:x1872861941775744:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1786100590.646134:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100590.646155:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac144f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3007 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786100590.646179:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786100590.646197:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1786100590.646201:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100590.646211:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac144f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3007 expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.646310:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac144f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3007 expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.646323:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99200, rc 0) 00000100:00080000:0.0:1786100590.646358:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786100590.646381:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+8:2353:x1872861941775744:12345-192.168.206.53@tcp:101:bash.0 Request processed in 268us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100590.646389:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:3.0:1786100590.649930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.650878:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941775872 00000100:00100000:2.0:1786100590.650890:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941775872 00000100:00100000:2.0:1786100590.650951:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:2.0:1786100590.650962:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:10505:x1872861941775872:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1786100590.650989:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100590.651008:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c300e expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.651041:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac144f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3007 expref: 9 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.651049:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100590.651054:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100590.651060:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.651094:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac144f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3007 expref: 9 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.651106:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac144f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3007 expref: 9 pid: 6684 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100590.651138:0:6686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6686:1872861960669312:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100590.651234:0:6686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7ce9c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100590.657892:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.658093:0:6686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6686:1872861960669312:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100590.658126:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.658146:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51ee00, rc 0) 00000100:00100000:2.0:1786100590.658206:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+9:10505:x1872861941775872:12345-192.168.206.53@tcp:101:bash.0 Request processed in 7245us (8283us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100590.658214:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:3.0:1786100590.658452:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941776000 00000100:00100000:3.0:1786100590.658460:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941776000 00010000:00010000:3.0:1786100590.658501:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac144f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3007 expref: 9 pid: 6684 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100590.658542:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:3.0:1786100590.658552:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+9:2352:x1872861941776000:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100590.658580:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100590.658600:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac144f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3007 expref: 9 pid: 6684 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.658612:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac144f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3007 expref: 9 pid: 6684 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.658806:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac144f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3007 expref: 9 pid: 6684 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.658820:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100590.658824:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100590.658832:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.658849:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.658883:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100590.658897:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74913b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1872861960669440:192.168.206.53@tcp:105: 00000100:00100000:3.0:1786100590.658948:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74900a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786100590.665838:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74913b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1872861960669440:192.168.206.53@tcp:105: 00010000:00010000:3.0:1786100590.665876:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100590.665937:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941776000:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 7385us (8053us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100590.665948:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:0.0:1786100590.673562:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.674027:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941776256 00000100:00100000:2.0:1786100590.674050:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941776256 00000100:00100000:2.0:1786100590.674112:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:2.0:1786100590.674123:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+33:10505:x1872861941776256:12345-192.168.206.53@tcp:35:bash.0 00000001:00080000:2.0:1786100590.674405:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967377 00000100:00100000:2.0:1786100590.674521:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+35:10505:x1872861941776256:12345-192.168.206.53@tcp:35:bash.0 Request processed in 398us (966us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1786100590.674529:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 25 00000020:00080000:2.0:1786100590.674534:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786100590.756866:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100590.880421:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100590.880536:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941776384 00000100:00100000:1.0:1786100590.880546:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941776384 00000100:00100000:1.0:1786100590.880608:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 97 00000100:00100000:1.0:1786100590.880620:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+35:10521:x1872861941776384:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100590.880679:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100590.880702:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac145d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3015 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.880768:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1464 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.880783:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.880808:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100590.880864:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1786100590.880868:0:9953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100590.880889:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.880915:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac145d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3015 expref: 37 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.880933:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3015 expref: 36 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.880941:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:1.0:1786100590.880944:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100590.880947:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f000, rc 0) 00000100:00100000:1.0:1786100590.881195:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+36:10521:x1872861941776384:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 576us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100590.881202:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 97 00000100:00100000:1.0:1786100590.888577:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100590.888692:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941776640 00000100:00100000:0.0:1786100590.888702:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941776640 00000100:00100000:0.0:1786100590.888767:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 98 00000100:00100000:0.0:1786100590.888778:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+36:10521:x1872861941776640:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1786100590.889076:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100590.889097:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac146b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c301c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.889195:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1472 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.889210:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1472 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.889221:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1472 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100590.889231:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1786100590.889349:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac146b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c301c expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.889367:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1472 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c301c expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.889375:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:0.0:1786100590.889378:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786100590.889381:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbba400, rc 0) 00000100:00100000:0.0:1786100590.889440:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+38:10521:x1872861941776640:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 664us (873us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1786100590.889447:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 98 00000100:00100000:0.0:1786100590.894866:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.894955:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941776896 00000100:00100000:2.0:1786100590.894964:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941776896 00000100:00100000:2.0:1786100590.895043:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 99 00000100:00100000:2.0:1786100590.895053:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+38:10521:x1872861941776896:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100590.895092:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100590.895113:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1480 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3023 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.895201:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1487 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.895215:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.895226:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100590.895237:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1786100590.895354:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1480 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3023 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.895373:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3023 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.895382:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:2.0:1786100590.895384:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786100590.895388:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f000, rc 0) 00000100:00100000:2.0:1786100590.895447:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+40:10521:x1872861941776896:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 396us (591us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1786100590.895455:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 99 00000100:00100000:1.0:1786100590.900432:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100590.900686:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941777024 00000100:00100000:3.0:1786100590.900698:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941777024 00000100:00100000:3.0:1786100590.900760:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:3.0:1786100590.900771:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+40:2353:x1872861941777024:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100590.900787:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100590.900811:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1472 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c301c expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.900830:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:3.0:1786100590.900834:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100590.900894:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+39:2353:x1872861941777024:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 124us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100590.900901:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:0.0:1786100590.908032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100590.908113:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941777152 00000100:00100000:3.0:1786100590.908123:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941777152 00000100:00100000:3.0:1786100590.908180:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:3.0:1786100590.908190:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941777152:12345-192.168.206.53@tcp:1:lfs.0 00010000:00010000:3.0:1786100590.908234:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.908254:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.908261:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786100590.908279:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786100590.908283:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.908321:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.908334:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 8 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100590.908349:0:6684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74913480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1872861960669568:192.168.206.53@tcp:104: 00000100:00100000:3.0:1786100590.908443:0:6684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74900900 going to sleep for 11 seconds 00000100:00100000:3.0:1786100590.911413:0:6684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74913480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1872861960669568:192.168.206.53@tcp:104: 00010000:00010000:3.0:1786100590.911444:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100590.912864:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.912981:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941777280 00000100:00100000:2.0:1786100590.912990:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941777280 00002000:00100000:2.0:1786100590.913038:0:6691:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a3c7491a680 x1872861941777280/t0(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:121/0 lens 504/0 e 0 to 0 dl 1786100601 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786100590.913056:0:6691:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c7491a680 with x1872861941777280 ext(0->8) 00010000:00010000:2.0:1786100590.913066:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 9 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.913084:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 9 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786100590.913091:0:6691:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a3c7491a680 00000100:00100000:2.0:1786100590.913129:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:2.0:1786100590.913139:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2a93440-3d3b-4616-8388-e39125c10990+9:2352:x1872861941777280:12345-192.168.206.53@tcp:4:lfs.0 00000100:00100000:2.0:1786100590.913575:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2a93440-3d3b-4616-8388-e39125c10990+11:2352:x1872861941777280:12345-192.168.206.53@tcp:4:lfs.0 Request processed in 436us (719us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1786100590.913583:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00002000:00100000:2.0:1786100590.913590:0:6691:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a3c7491a680 x1872861941777280/t4294967302(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:121/0 lens 504/448 e 0 to 0 dl 1786100601 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786100590.913597:0:6691:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c7491a680 with x1872861941777280 ext(0->8) 00010000:00010000:2.0:1786100590.913602:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 11 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.913613:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 11 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786100590.913619:0:6691:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a3c7491a680 00000100:00100000:0.0:1786100590.918360:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.918597:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941777408 00000100:00100000:2.0:1786100590.918619:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941777408 00010000:00010000:2.0:1786100590.918747:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 11 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100590.918833:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:2.0:1786100590.918844:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+11:2354:x1872861941777408:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100590.918860:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1786100590.918878:0:11178:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1786100590.918881:0:11178:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1786100590 00002000:00010000:2.0:1786100590.918883:0:11178:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1786100590 00002000:00010000:2.0:1786100590.918886:0:11178:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1786100590 00010000:00010000:2.0:1786100590.918893:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 11 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.918906:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 11 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.918930:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1456 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c300e expref: 11 pid: 6686 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.918946:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786100590.918950:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786100590.918956:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.918965:0:11178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.919025:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100590.919081:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+10:2354:x1872861941777408:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 239us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100590.919089:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 50 00010000:00010000:1.0:1786100590.919145:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.919153:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.919187:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.919195:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.919203:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.919209:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99200 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100590.919213:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.919222:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.919235:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100590.919242:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005484781c/0x5564f2c20ac1495 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100590.919289:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+9:2352:x1872861941777152:12345-192.168.206.53@tcp:1:lfs.0 Request processed in 11101us (11266us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100590.919296:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:1.0:1786100590.923570:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.923684:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941777664 00000100:00100000:2.0:1786100590.923694:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941777664 00000100:00100000:2.0:1786100590.923739:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:2.0:1786100590.923748:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6af00850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+39:10521:x1872861941777664:12345-192.168.206.53@tcp:35:lfs.0 00000004:00010000:2.0:1786100590.923807:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3023 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786100590.924036:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1786100590.924076:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1786100590.924339:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:2.0:1786100590.924387:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.924401:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1441 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3000 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.924408:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.924439:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3000 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.924452:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1441 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3000 expref: 43 pid: 5843 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100590.924480:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1872861960669696:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100590.924553:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7ce9c840 going to sleep for 11 seconds 00000100:00100000:0.0:1786100590.932412:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100590.932509:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1872861960669696:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100590.932536:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100590.932598:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941777792 00000100:00100000:3.0:1786100590.932605:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941777792 00010000:00010000:3.0:1786100590.932687:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1441 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3000 expref: 44 pid: 5843 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100590.932716:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:3.0:1786100590.932726:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+44:2351:x1872861941777792:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100590.932742:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100590.932748:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1441 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3000 expref: 44 pid: 5843 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.932777:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3000 expref: 44 pid: 5843 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.932801:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1441 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3000 expref: 44 pid: 5843 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.932816:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:3.0:1786100590.932821:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.932830:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.932837:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.932859:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100590.932918:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+43:2351:x1872861941777792:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 193us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100590.932926:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 51 00010000:00010000:2.0:1786100590.933274:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100590.933282:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786100590.933409:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1786100590.933586:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1786100590.933715:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1872861960669824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786100590.933761:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100590.933785:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47de4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786100590.933845:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960669824 00000100:00100000:1.0:1786100590.933851:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960669824 00000100:00100000:1.0:1786100590.933893:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786100590.933901:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1872861960669824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786100590.933993:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1872861960669824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100590.934001:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786100590.934312:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1872861960669824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1786100590.934775:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1786100590.934830:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74913480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1872861960669952:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786100590.934866:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100590.934992:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74900300 going to sleep for 11 seconds 00000100:00100000:1.0:1786100590.937718:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960669952 00000100:00100000:1.0:1786100590.937731:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960669952 00000100:00100000:1.0:1786100590.937778:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786100590.937787:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1872861960669952:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786100590.938243:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5847:x1872861960669952:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 456us (3375us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1786100590.938251:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786100590.938361:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74913480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1872861960669952:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1786100590.938428:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1786100590.938471:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.938481:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.938488:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.938493:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51ec00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100590.938498:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.938505:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.938773:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:0.0:1786100590.938777:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1786100590.938783:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100590.938790:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac149c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786100590.938996:0:5847:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1786100590.939097:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1786100590.939110:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332181459105ns, next at 333181456391ns, rc = 0 00000001:00080000:0.0:1786100590.939130:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1786100590.939165:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:0.0:1786100590.939169:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786100590.939176:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1487 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3023 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100590.939443:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6af00850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+46:10521:x1872861941777664:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 15695us (15881us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1786100590.939452:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 26 00000020:00080000:0.0:1786100590.939457:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1786100590.947396:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100590.948639:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941777920 00000100:00100000:3.0:1786100590.948665:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941777920 00000100:00100000:3.0:1786100590.948752:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 100 00000100:00100000:3.0:1786100590.948764:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+46:10521:x1872861941777920:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100590.948808:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100590.948835:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac14a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c302a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.948917:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac14a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c302a expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.948933:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac14a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c302a expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100590.948954:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:3.0:1786100590.948958:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786100590.948962:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99a00, rc 0) 00000100:00100000:3.0:1786100590.949608:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+47:10521:x1872861941777920:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 842us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100590.949617:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 100 00000100:00100000:1.0:1786100590.958188:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100590.958275:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941778176 00000100:00100000:0.0:1786100590.958285:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941778176 00000100:00100000:0.0:1786100590.958334:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:0.0:1786100590.958344:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+47:10521:x1872861941778176:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1786100590.958571:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+48:10521:x1872861941778176:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 228us (391us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1786100590.958579:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:1.0:1786100591.097724:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100591.097826:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941778304 00000100:00100000:2.0:1786100591.097835:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941778304 00000100:00100000:2.0:1786100591.097898:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 101 00000100:00100000:2.0:1786100591.097909:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+48:10531:x1872861941778304:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:2.0:1786100591.098005:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac14aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098023:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac14aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098049:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac14aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098065:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac14b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098071:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac14b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098076:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac14b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098166:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098173:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098179:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100591.098215:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098225:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac14aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098231:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac14aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098237:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac14aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098251:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51ee00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100591.098255:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac14aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098262:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac14aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098274:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:2.0:1786100591.098276:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100591.098280:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac14aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098286:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac14aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098297:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac14b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098302:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac14b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098307:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac14b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098311:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100591.098313:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac14b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098318:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac14b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098331:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c58043700) 00010000:00010000:2.0:1786100591.098334:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100591.098336:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac14b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098342:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac14b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098354:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098360:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098366:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098370:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100591.098373:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098378:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098383:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:2.0:1786100591.098385:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100591.098388:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.098392:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100591.098600:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+48:10531:x1872861941778304:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 691us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100591.098608:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 101 00000100:00100000:1.0:1786100591.171279:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100591.171480:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941778560 00000100:00100000:0.0:1786100591.171490:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941778560 00000100:00100000:0.0:1786100591.171679:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 102 00000100:00100000:0.0:1786100591.171700:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+48:10534:x1872861941778560:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1786100591.171721:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100591.171742:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac14bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3031 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.171809:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac14c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.171834:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac14c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.171845:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac14c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.171860:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac14cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.171868:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac14cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.171874:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac14cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172003:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac14d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172012:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac14d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172020:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac14d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100591.172029:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1786100591.172111:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac14c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172118:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac14c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172124:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac14c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172137:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100591.172141:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac14c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172149:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac14c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172161:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:0.0:1786100591.172164:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100591.172169:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac14c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172176:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac14c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172189:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac14cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172209:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac14cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172215:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac14cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172221:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbba00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100591.172224:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac14cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172230:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac14cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172249:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c433df000) 00010000:00010000:0.0:1786100591.172252:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100591.172255:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac14cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172261:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac14cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172297:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac14bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3031 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172311:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac14d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3031 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.172319:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:0.0:1786100591.172321:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786100591.172324:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbbe00, rc 0) 00000100:00100000:0.0:1786100591.172601:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+50:10534:x1872861941778560:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 911us (1329us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1786100591.172609:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 102 00000100:00100000:1.0:1786100591.179255:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100591.179390:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941778688 00000100:00100000:2.0:1786100591.179400:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941778688 00000100:00100000:2.0:1786100591.179460:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 103 00000100:00100000:2.0:1786100591.179471:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+50:10534:x1872861941778688:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:2.0:1786100591.179534:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.179550:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.179562:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.179588:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.179595:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.179602:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.179608:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100591.179613:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.179620:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.179645:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:2.0:1786100591.179673:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786100591.179679:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.179685:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac14e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100591.179869:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+50:10534:x1872861941778688:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 399us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100591.179877:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 103 00000100:00100000:1.0:1786100591.183770:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100591.184594:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941778944 00000100:00100000:0.0:1786100591.184606:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941778944 00000100:00100000:0.0:1786100591.184956:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:0.0:1786100591.184982:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+50:10534:x1872861941778944:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1786100591.185210:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+51:10534:x1872861941778944:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 241us (1447us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1786100591.185217:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:1.0:1786100591.271075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.271238:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941779200 00000100:00100000:3.0:1786100591.271247:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941779200 00000100:00100000:3.0:1786100591.271308:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 104 00000100:00100000:3.0:1786100591.271318:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+51:10544:x1872861941779200:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1786100591.271340:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100591.271343:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786100591.271369:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1464 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3015 expref: 51 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.271405:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:3.0:1786100591.271410:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786100591.271424:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac14e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3038 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.271511:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.271524:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac14d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3031 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.271532:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.271565:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac14d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3031 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.271578:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac14d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3031 expref: 51 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100591.271592:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74910700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1872861960670080:192.168.206.53@tcp:104: 00000100:00100000:3.0:1786100591.272065:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74900780 going to sleep for 11 seconds 00000100:00100000:1.0:1786100591.275995:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.276335:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74910700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1872861960670080:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100591.276347:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941779328 00000100:00100000:2.0:1786100591.276356:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941779328 00010000:00010000:2.0:1786100591.276395:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac14d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3031 expref: 52 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.276433:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100591.276439:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:2.0:1786100591.276454:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+52:2352:x1872861941779328:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100591.276469:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100591.276476:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac14d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3031 expref: 52 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.276489:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac14d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3031 expref: 52 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.276511:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac14d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3031 expref: 52 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.276555:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:2.0:1786100591.276560:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.276570:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.276578:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.276607:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100591.276859:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+51:2352:x1872861941779328:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 243us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100591.276867:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 52 00010000:00010000:3.0:1786100591.277172:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.277188:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100591.277207:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1786100591.277357:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac14e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3038 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.277372:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3038 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.277379:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:3.0:1786100591.277382:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786100591.277384:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99400, rc 0) 00000100:00100000:3.0:1786100591.277429:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+51:10544:x1872861941779200:12345-192.168.206.53@tcp:101:bash.0 Request processed in 6112us (6362us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1786100591.277436:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 104 00000100:00100000:1.0:1786100591.282368:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.282443:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941779584 00000100:00100000:3.0:1786100591.282453:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941779584 00000100:00100000:3.0:1786100591.282509:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 105 00000100:00100000:3.0:1786100591.282528:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+51:10544:x1872861941779584:12345-192.168.206.53@tcp:36:bash.0 00010000:00010000:3.0:1786100591.282944:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac14fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.282962:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac14fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.283039:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac14fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786100591.283107:0:9953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1786100591.283131:0:9953:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063bd012b reply state 000000009a60cd6f transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac14fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100591.283141:0:9953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786100591.283231:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+54:10544:x1872861941779584:12345-192.168.206.53@tcp:36:bash.0 Request processed in 703us (869us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1786100591.283239:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 105 00000020:00080000:3.0:1786100591.283244:0:9953:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786100591.285271:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac14fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.285286:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac14fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.285293:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac14fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.285299:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100591.285303:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac14fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.285310:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac14fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.285325:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:0.0:1786100591.285328:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100591.285332:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac14fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.285337:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac14fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100591.288415:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100591.288494:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941779712 00000100:00100000:0.0:1786100591.288504:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941779712 00000100:00100000:0.0:1786100591.288562:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 106 00000100:00100000:0.0:1786100591.288573:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+53:10544:x1872861941779712:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1786100591.288596:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100591.288617:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1505 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c303f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.288914:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.288930:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3038 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.288938:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.288986:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3038 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.289000:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3038 expref: 54 pid: 5843 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100591.289014:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960670208:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100591.289093:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c51e77000 going to sleep for 11 seconds 00000100:00100000:0.0:1786100591.292923:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960670208:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100591.292953:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100591.293890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.293977:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941779840 00000100:00100000:3.0:1786100591.293985:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941779840 00010000:00010000:3.0:1786100591.294023:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3038 expref: 55 pid: 5843 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100591.294065:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:3.0:1786100591.294076:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+55:2351:x1872861941779840:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100591.294090:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100591.294097:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3038 expref: 55 pid: 5843 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.294110:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3038 expref: 55 pid: 5843 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.294132:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac14f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3038 expref: 55 pid: 5843 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.294147:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:3.0:1786100591.294164:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.294174:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.294181:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.294216:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100591.294267:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+54:2351:x1872861941779840:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 192us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100591.294275:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 53 00010000:00010000:2.0:1786100591.294477:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.294485:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100591.294539:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1786100591.294543:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100591.294562:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.294590:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1505 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c303f expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.294604:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c303f expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.294621:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:2.0:1786100591.294624:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100591.294626:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbba00, rc 0) 00000100:00100000:2.0:1786100591.294950:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+53:10544:x1872861941779712:12345-192.168.206.53@tcp:101:bash.0 Request processed in 6378us (6545us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100591.294958:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 106 00000100:00100000:1.0:1786100591.299072:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.299645:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941780096 00000100:00100000:3.0:1786100591.299715:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941780096 00000100:00100000:3.0:1786100591.299763:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:3.0:1786100591.299773:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+53:10544:x1872861941780096:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:3.0:1786100591.300007:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+54:10544:x1872861941780096:12345-192.168.206.53@tcp:35:bash.0 Request processed in 234us (943us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1786100591.300014:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:1.0:1786100591.379080:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.379175:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941780224 00000100:00100000:3.0:1786100591.379185:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941780224 00000100:00100000:3.0:1786100591.379243:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 107 00000100:00100000:3.0:1786100591.379254:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+54:10550:x1872861941780224:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100591.379279:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100591.379301:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1513 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3046 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.379362:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac151a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.379383:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac151a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.379395:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac151a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100591.379453:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1786100591.379457:0:9953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786100591.379479:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac151a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.379504:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1513 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3046 expref: 56 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.379522:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac151a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3046 expref: 55 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.379545:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:3.0:1786100591.379548:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786100591.379551:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99800, rc 0) 00000100:00100000:3.0:1786100591.379739:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+55:10550:x1872861941780224:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 486us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100591.379747:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 107 00000100:00100000:2.0:1786100591.389439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.389589:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941780352 00000100:00100000:3.0:1786100591.389599:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941780352 00000100:00100000:3.0:1786100591.389934:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 108 00000100:00100000:3.0:1786100591.389946:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+55:10550:x1872861941780352:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100591.389981:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100591.390014:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac1521 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c304d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390089:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1528 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390104:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1528 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390115:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1528 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390129:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac152f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390135:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac152f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390142:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac152f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390234:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1536 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390244:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390251:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100591.390284:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1786100591.390288:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786100591.390305:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390322:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390330:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1528 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390337:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1528 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390345:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1528 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390351:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100591.390356:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1528 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390364:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1528 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390376:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:3.0:1786100591.390379:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100591.390384:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1528 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390390:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1528 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390403:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac152f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390410:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac152f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390425:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac152f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390431:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100591.390434:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac152f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390441:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac152f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390448:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c454ab500) 00010000:00010000:3.0:1786100591.390451:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100591.390454:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac152f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390460:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac152f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390488:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac1521 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c304d expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390501:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c304d expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.390509:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:3.0:1786100591.390511:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786100591.390514:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99e00, rc 0) 00000100:00100000:3.0:1786100591.390588:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+56:10550:x1872861941780352:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 645us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100591.390605:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 108 00000100:00100000:0.0:1786100591.394283:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100591.394505:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941780480 00000100:00100000:2.0:1786100591.394515:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941780480 00000100:00100000:2.0:1786100591.394585:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:2.0:1786100591.394595:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+56:2351:x1872861941780480:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100591.394610:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100591.394644:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1536 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c304d expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.394891:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:2.0:1786100591.394896:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100591.394957:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+55:2351:x1872861941780480:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 362us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100591.395307:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:1.0:1786100591.399390:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100591.399462:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941780736 00000100:00100000:2.0:1786100591.399472:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941780736 00000100:00100000:2.0:1786100591.399528:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 109 00000100:00100000:2.0:1786100591.399538:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+55:10550:x1872861941780736:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100591.399559:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100591.399590:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e600/0x5564f2c20ac153d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3054 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.399904:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.399921:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c303f expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.399931:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.399982:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c303f expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.399996:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c303f expref: 56 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100591.400011:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960670336:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100591.400139:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47de4780 going to sleep for 11 seconds 00000100:00100000:1.0:1786100591.404380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.404451:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941780864 00000100:00100000:3.0:1786100591.404460:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941780864 00010000:00010000:3.0:1786100591.404497:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c303f expref: 57 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100591.404550:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00100000:3.0:1786100591.404560:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+57:2352:x1872861941780864:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100591.404575:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100591.404582:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c303f expref: 57 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.404595:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c303f expref: 57 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.404616:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:3.0:1786100591.404621:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.404643:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.404679:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.404849:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100591.404904:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+57:2352:x1872861941780864:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 345us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100591.404927:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 54 00010000:00010000:2.0:1786100591.406366:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac150c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c303f expref: 56 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100591.406390:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960670336:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100591.406414:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.406423:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.406445:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100591.406465:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1786100591.406980:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e600/0x5564f2c20ac153d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3054 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.406999:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3054 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.407008:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:2.0:1786100591.407011:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786100591.407014:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f400, rc 0) 00000100:00100000:2.0:1786100591.407068:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+56:10550:x1872861941780736:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 7531us (7687us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1786100591.407077:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 109 00000100:00100000:3.0:1786100591.410291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100591.410498:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941781120 00000100:00100000:0.0:1786100591.410508:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941781120 00000100:00100000:0.0:1786100591.410678:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:0.0:1786100591.410698:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+56:10550:x1872861941781120:12345-192.168.206.53@tcp:103:lfs.0 00010000:00010000:0.0:1786100591.410729:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100591.410754:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac14a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c302a expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.410771:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:0.0:1786100591.410775:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100591.410826:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+55:10550:x1872861941781120:12345-192.168.206.53@tcp:103:lfs.0 Request processed in 139us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100591.410834:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:3.0:1786100591.412722:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100591.412862:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941781248 00000100:00100000:2.0:1786100591.412872:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941781248 00000100:00100000:2.0:1786100591.412921:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 110 00000100:00100000:2.0:1786100591.412930:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+55:10550:x1872861941781248:12345-192.168.206.53@tcp:58:lfs.0 00010000:00010000:2.0:1786100591.413031:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1552 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.413046:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1552 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.413056:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1552 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786100591.413249:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1786100591.413431:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+55:10550:x1872861941781248:12345-192.168.206.53@tcp:58:lfs.0 Request processed in 501us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100591.413440:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 110 00000100:00100000:1.0:1786100591.420748:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.420884:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941781376 00000100:00100000:3.0:1786100591.420894:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941781376 00000100:00100000:3.0:1786100591.420940:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 111 00000100:00100000:3.0:1786100591.420949:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+55:10550:x1872861941781376:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100591.420986:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100591.421007:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac1559 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c305b expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.421061:0:9953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1552 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.421073:0:9953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac1559 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c305b expref: 56 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.421093:0:9953:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1552 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.421107:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac1559 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c305b expref: 56 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.421121:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:3.0:1786100591.421124:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786100591.421128:0:9953:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac1559 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c305b expref: 56 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.421152:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98a00, rc 0) 00000100:00100000:3.0:1786100591.421212:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+56:10550:x1872861941781376:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 263us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100591.421220:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 111 00000040:00080000:1.0:1786100591.525566:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786100591.525574:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786100591.525634:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1786100591.525641:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786100591.526106:0:11696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745b0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1872861960670464:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786100591.526195:0:11696:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47aa9300 going to sleep for 11 seconds 00000100:00100000:3.0:1786100591.540238:0:11696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745b0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1872861960670464:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786100591.551573:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.551722:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941781504 00000100:00100000:3.0:1786100591.551734:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941781504 00000100:00100000:3.0:1786100591.551785:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 112 00000100:00100000:3.0:1786100591.551796:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+56:10551:x1872861941781504:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786100591.551826:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786100591.551919:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+56:10551:x1872861941781504:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 124us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100591.551926:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 112 00000100:00100000:2.0:1786100591.571542:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.571847:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941781632 00000100:00100000:3.0:1786100591.571857:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941781632 00000100:00100000:3.0:1786100591.571914:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 113 00000100:00100000:3.0:1786100591.571925:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+56:10551:x1872861941781632:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1786100591.572003:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1560 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572019:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1560 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572031:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1560 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572061:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1567 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572070:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1567 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572077:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1567 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572101:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac156e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572109:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac156e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572116:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac156e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100591.572151:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1786100591.572155:0:9953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786100591.572171:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac156e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572182:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1560 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572188:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1560 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572195:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1560 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572211:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100591.572215:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1560 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572223:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1560 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572235:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df900) 00010000:00010000:3.0:1786100591.572238:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100591.572243:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1560 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572248:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1560 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572261:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1567 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572267:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1567 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572273:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1567 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572279:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100591.572282:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1567 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572288:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1567 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572306:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9a3c454ab500) 00010000:00010000:3.0:1786100591.572308:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100591.572311:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1567 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572318:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1567 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572331:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac156e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572337:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac156e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572343:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac156e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572348:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100591.572351:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac156e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572357:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac156e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572364:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:3.0:1786100591.572366:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100591.572369:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac156e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.572375:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac156e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100591.572471:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+56:10551:x1872861941781632:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 Request processed in 547us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100591.572479:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 113 00000100:00100000:3.0:1786100591.577756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100591.584870:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941781888 00000100:00100000:2.0:1786100591.584885:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941781888 00000100:00100000:3.0:1786100591.585573:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 114 00000100:00100000:3.0:1786100591.585585:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+56:10551:x1872861941781888:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786100591.585608:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100591.585628:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac1575 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3062 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.586056:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac157c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.586073:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac157c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.586084:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac157c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100591.586096:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1786100591.586192:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac157c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.586200:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac157c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.586207:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac157c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.586229:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99a00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100591.586234:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac157c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.586243:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac157c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.586256:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:3.0:1786100591.586259:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786100591.586263:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac157c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.586270:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac157c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.586312:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac1575 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3062 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.586322:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df900) 00010000:00010000:3.0:1786100591.586325:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786100591.586329:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac1575 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3062 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.586339:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98200, rc 0) 00000100:00100000:3.0:1786100591.587574:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+57:10551:x1872861941781888:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 1983us (9920us total) trans 4294967398 rc 301/301 00000100:00100000:3.0:1786100591.587585:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 114 00000100:00100000:2.0:1786100591.597985:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100591.598090:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941782016 00000100:00100000:0.0:1786100591.598101:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941782016 00000100:00100000:0.0:1786100591.598161:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:0.0:1786100591.598171:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+57:10551:x1872861941782016:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786100591.598207:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786100591.598313:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+57:10551:x1872861941782016:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 142us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100591.598321:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:2.0:1786100591.605237:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100591.605544:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941782272 00000100:00100000:1.0:1786100591.605554:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941782272 00000100:00100000:1.0:1786100591.605617:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:1.0:1786100591.605628:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+57:10551:x1872861941782272:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786100591.605701:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100591.605705:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786100591.605733:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac151a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3046 expref: 57 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.605752:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:1.0:1786100591.605757:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786100591.605772:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac158a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3069 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786100591.606156:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1786100591.606355:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1591 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.606400:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.606411:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.606469:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac158a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3069 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.606485:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1591 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3069 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.606492:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:1.0:1786100591.606495:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786100591.606498:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165fc00, rc 0) 00000100:00100000:1.0:1786100591.606567:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+58:10551:x1872861941782272:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 940us (1338us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1786100591.606575:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:2.0:1786100591.610903:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100591.611019:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941782528 00000100:00100000:0.0:1786100591.611029:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941782528 00000100:00100000:0.0:1786100591.611094:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00100000:0.0:1786100591.611104:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+58:10551:x1872861941782528:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786100591.611160:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100591.611186:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1591 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3069 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611204:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:0.0:1786100591.611227:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786100591.611248:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac159f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611512:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac159f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611524:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac159f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611541:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac15a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x99c7d552 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611548:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac15a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x99c7d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611554:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac15a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x99c7d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611626:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac159f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611633:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac159f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611640:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac159f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611645:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100591.611771:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac159f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611781:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac159f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611797:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:0.0:1786100591.611800:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100591.611804:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac159f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611810:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac159f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611821:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac15a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x99c7d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611827:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac15a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x99c7d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611833:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac15a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x99c7d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611838:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbae00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100591.611841:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac15a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x99c7d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611847:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac15a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x99c7d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611854:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x99c7d552 (ffff9a3c433df000) 00010000:00010000:0.0:1786100591.611856:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100591.611859:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac15a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x99c7d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.611864:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac15a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x99c7d552 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100591.611972:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+57:10551:x1872861941782528:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 860us (1074us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786100591.611980:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00100000:2.0:1786100591.614217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100591.614480:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941782656 00000100:00100000:1.0:1786100591.614490:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941782656 00000100:00100000:1.0:1786100591.614597:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 118 00000100:00100000:1.0:1786100591.614609:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+57:10551:x1872861941782656:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786100591.614631:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100591.614712:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac15ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3070 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.614747:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac15b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.614773:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac15b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.614785:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac15b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.614870:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac15ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3070 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.614889:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac15b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3070 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.614898:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:1.0:1786100591.614901:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786100591.614903:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f000, rc 0) 00000100:00100000:1.0:1786100591.614972:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+58:10551:x1872861941782656:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 355us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100591.614980:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 118 00000100:00100000:2.0:1786100591.618421:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.618686:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941782912 00000100:00100000:3.0:1786100591.618708:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941782912 00000100:00100000:3.0:1786100591.618760:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 119 00000100:00100000:3.0:1786100591.618769:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+58:10551:x1872861941782912:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786100591.618845:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac15bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.618863:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac15bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.618874:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac15bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786100591.619357:0:9953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1786100591.619366:0:9953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332861714554ns, next at 333861712674ns, rc = 0 00000004:00010000:3.0:1786100591.619448:0:9953:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044667767 reply state 000000006e2cbbe0 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac15bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100591.619457:0:9953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786100591.619555:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+60:10551:x1872861941782912:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 786us (1142us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1786100591.619563:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 119 00010000:00010000:0.0:1786100591.622497:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac15bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.622513:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac15bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.622521:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac15bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.622528:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100591.622533:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac15bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.622539:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac15bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.622554:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:0.0:1786100591.622557:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786100591.622561:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac15bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.622566:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac15bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100591.625561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.626295:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941783040 00000100:00100000:3.0:1786100591.626305:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941783040 00000100:00100000:3.0:1786100591.626362:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 120 00000100:00100000:3.0:1786100591.626371:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+59:10551:x1872861941783040:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786100591.626397:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100591.626416:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac15c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3077 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.626489:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac15c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3077 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.626503:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac15c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3077 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.626530:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:3.0:1786100591.626533:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786100591.626537:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99a00, rc 0) 00000100:00100000:3.0:1786100591.626589:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+60:10551:x1872861941783040:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 219us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100591.626596:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 120 00000100:00100000:2.0:1786100591.630803:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.630880:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941783168 00000100:00100000:3.0:1786100591.630890:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941783168 00000100:00100000:3.0:1786100591.630952:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00080000:0.0:1786100591.630992:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786100591.631054:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+8:2351:x1872861941783168:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1786100591.631405:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+9:2351:x1872861941783168:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 443us (608us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1786100591.631413:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:1.0:1786100591.635913:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.636245:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941783424 00000100:00100000:3.0:1786100591.636256:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941783424 00000100:00100000:3.0:1786100591.636310:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 30 00000100:00100000:3.0:1786100591.636323:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+60:10551:x1872861941783424:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786100591.636582:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+61:10551:x1872861941783424:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 262us (677us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1786100591.636607:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 30 00000100:00100000:2.0:1786100591.642136:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100591.645823:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941783680 00000100:00100000:1.0:1786100591.645837:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941783680 00000100:00100000:1.0:1786100591.646144:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:1.0:1786100591.646156:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+61:10551:x1872861941783680:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786100591.646271:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+61:10551:x1872861941783680:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 117us (4143us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100591.646279:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:2.0:1786100591.649742:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.649867:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941783808 00000100:00100000:3.0:1786100591.649876:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941783808 00000100:00100000:3.0:1786100591.649918:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 122 00000100:00100000:3.0:1786100591.649927:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+61:10551:x1872861941783808:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786100591.649946:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100591.649975:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac15c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c307e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.650036:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac15d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.650049:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac15d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.650059:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac15d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100591.650089:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786100591.650104:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac15d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.650127:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac15c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c307e expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.650143:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac15d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c307e expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.650152:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:3.0:1786100591.650166:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786100591.650169:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99000, rc 0) 00000100:00100000:3.0:1786100591.650222:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+62:10551:x1872861941783808:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 296us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100591.650230:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 122 00000100:00100000:2.0:1786100591.660066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100591.660200:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941783936 00000100:00100000:0.0:1786100591.660210:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941783936 00000100:00100000:0.0:1786100591.660280:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:0.0:1786100591.660291:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+9:2352:x1872861941783936:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786100591.660310:0:9414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100591.660330:0:9414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac15d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3085 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786100591.660356:0:9414:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a75bb6e, blocks: 0x1 00010000:00010000:0.0:1786100591.660375:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1786100591.660513:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100591.660589:0:9414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac15d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3085 expref: 10 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.660610:0:9414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac15d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3085 expref: 10 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.660624:0:9414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbae00, rc 0) 00000100:00100000:0.0:1786100591.660838:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+10:2352:x1872861941783936:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 548us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100591.660847:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:2.0:1786100591.676633:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.676704:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941784192 00000100:00100000:3.0:1786100591.676716:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941784192 00000100:00100000:3.0:1786100591.676778:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 123 00000100:00100000:3.0:1786100591.676789:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+62:10551:x1872861941784192:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786100591.678274:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+62:10551:x1872861941784192:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 1478us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100591.678286:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 123 00000100:00100000:2.0:1786100591.686585:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.686680:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941784320 00000100:00100000:3.0:1786100591.686689:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941784320 00000100:00100000:3.0:1786100591.686747:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:3.0:1786100591.686758:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+10:10551:x1872861941784320:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786100591.686776:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100591.686795:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043c3c4fb/0x5564f2c20ac15de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c308c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.686831:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac15d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3085 expref: 11 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.686841:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100591.686845:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100591.686851:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043c3c4fb/0x5564f2c20ac15de lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c308c expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.686900:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac15d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3085 expref: 11 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.686933:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac15d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3085 expref: 11 pid: 9414 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100591.686949:0:6686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74910380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6686:1872861960670592:192.168.206.53@tcp:104: 00000100:00100000:3.0:1786100591.687070:0:6686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c749006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100591.697308:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100591.697464:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941784448 00000100:00100000:0.0:1786100591.697473:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941784448 00010000:00010000:0.0:1786100591.697512:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac15d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3085 expref: 12 pid: 9414 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100591.697622:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00100000:0.0:1786100591.697632:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+12:2352:x1872861941784448:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100591.697882:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100591.697907:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac15d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3085 expref: 12 pid: 9414 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100591.697909:0:6686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74910380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6686:1872861960670592:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100591.697920:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac15d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3085 expref: 12 pid: 9414 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.697941:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac15d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3085 expref: 12 pid: 9414 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.697948:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043c3c4fb/0x5564f2c20ac15de lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c308c expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.697956:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100591.697960:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100591.697980:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043c3c4fb/0x5564f2c20ac15de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c308c expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.697989:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043c3c4fb/0x5564f2c20ac15de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c308c expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.698002:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99400, rc 0) 00010000:00010000:0.0:1786100591.698022:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000043c3c4fb/0x5564f2c20ac15de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c308c expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100591.698034:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74918e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1872861960670720:192.168.206.53@tcp:105: 00000100:00100000:3.0:1786100591.698064:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+11:10551:x1872861941784320:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 11308us (11490us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100591.698072:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:0.0:1786100591.698079:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c51e77000 going to sleep for 11 seconds 00000100:00100000:3.0:1786100591.701485:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74918e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1872861960670720:192.168.206.53@tcp:105: 00010000:00010000:3.0:1786100591.701509:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100591.701619:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+10:2352:x1872861941784448:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 3986us (4317us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100591.701631:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00100000:2.0:1786100591.705277:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100591.712701:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941784576 00000100:00100000:2.0:1786100591.712716:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941784576 00002000:00100000:2.0:1786100591.712774:0:6690:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a3c7f3b1880 x1872861941784576/t0(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:122/0 lens 504/0 e 0 to 0 dl 1786100602 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786100591.712804:0:6690:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c7f3b1880 with x1872861941784576 ext(0->12) 00002000:00010000:2.0:1786100591.712810:0:6690:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c7f3b1880 00000100:00100000:2.0:1786100591.713083:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:2.0:1786100591.713167:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2a93440-3d3b-4616-8388-e39125c10990+10:2352:x1872861941784576:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786100591.713644:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2a93440-3d3b-4616-8388-e39125c10990+12:2352:x1872861941784576:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 Request processed in 548us (8373us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1786100591.714866:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00002000:00100000:2.0:1786100591.714881:0:6690:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a3c7f3b1880 x1872861941784576/t4294967308(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:122/0 lens 504/448 e 0 to 0 dl 1786100602 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786100591.714892:0:6690:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c7f3b1880 with x1872861941784576 ext(0->12) 00002000:00010000:2.0:1786100591.714897:0:6690:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c7f3b1880 00000100:00100000:2.0:1786100591.720238:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.720320:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941784704 00000100:00100000:3.0:1786100591.720329:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941784704 00000100:00100000:3.0:1786100591.720395:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 124 00000100:00100000:3.0:1786100591.720406:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+62:10551:x1872861941784704:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1786100591.762465:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000004:00080000:1.0:1786100591.762488:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:3.0:1786100591.762728:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786100591.762759:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960670848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786100591.762823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100591.762888:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960670848 00000100:00100000:3.0:1786100591.762895:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960670848 00000100:00100000:3.0:1786100591.762935:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786100591.762944:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1872861960670848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786100591.762983:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1786100591.763013:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a75bb6e, atime: 0x6a75bb6e, ctime: 0x6a75bb6e, blocks: 0x1 00010000:00010000:3.0:1786100591.763021:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac15e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.763036:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=333s v=(0 0) 00010000:00010000:3.0:1786100591.763040:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100591.763046:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac15e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.763061:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac15e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.763072:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac15e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.763079:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac15e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.763098:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:1.0:1786100591.763630:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000020:00080000:1.0:1786100591.763661:0:5865:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a3c47aa9840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1786100591.763666:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c45831e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c47aa9b40 00000020:00080000:1.0:1786100591.763670:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c45831500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c7f3ee800 00000004:00080000:1.0:1786100591.763713:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:1.0:1786100591.763737:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:1.0:1786100591.763743:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1786100591.763757:0:5865:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a3c74900240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1786100591.763761:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c6e026b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c74900900 00000020:00080000:1.0:1786100591.763764:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c6e026100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c71bfd000 00000020:00080000:1.0:1786100591.763779:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1786100591.763906:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1786100591.764384:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3306:x1872861960670848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1438us (1557us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1786100591.764400:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1786100591.764430:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100591.764437:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac15e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.764449:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100591.764453:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac15e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.764464:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac15e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.764483:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac15e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.764492:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac15e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.764512:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100591.764666:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786100591.764682:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960671104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786100591.764727:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100591.764781:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960671104 00000100:00100000:0.0:1786100591.764787:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960671104 00000100:00100000:0.0:1786100591.764828:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786100591.764837:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1872861960671104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786100591.764955:0:9414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1786100591.764959:0:9414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1786100591 00002000:00010000:0.0:1786100591.765035:0:9414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786100591.765038:0:9414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1786100590 -> 1786100591 00002000:00010000:0.0:1786100591.765041:0:9414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1786100591.765076:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1872861960671104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (349us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1786100591.765083:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1786100591.765106:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1786100591.765135:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a3c7fbf8000/2, rc 0, transno 4294967309 00000100:00100000:0.0:1786100591.765141:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960671104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786100591.765221:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+15:10551:x1872861941784704:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 Request processed in 44815us (44989us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100591.765229:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 124 00000100:00100000:1.0:1786100591.765784:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960670976:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786100591.765821:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1786100591.765860:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a3c74910380/2, rc 0, transno 4294967304 00000100:00100000:1.0:1786100591.765865:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960670848:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1786100591.766098:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100591.766104:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100591.766124:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960670976 00000100:00100000:3.0:1786100591.766129:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960670976 00000100:00100000:3.0:1786100591.766169:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786100591.766178:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1872861960670976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786100591.766200:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1786100591.766220:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.766249:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac13a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2feb expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.766258:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1786100591.766263:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786100591.766268:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.766297:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac13a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2feb expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.766311:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac13a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2feb expref: 11 pid: 6686 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100591.766324:0:6684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74911f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1872861960671232:192.168.206.53@tcp:104: 00000100:00100000:3.0:1786100591.766456:0:6684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74900f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786100591.771734:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100591.773216:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100591.773295:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941784960 00000100:00100000:2.0:1786100591.773304:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941784960 00010000:00010000:2.0:1786100591.773343:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac13a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2feb expref: 12 pid: 6686 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100591.773391:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 56 00000100:00100000:2.0:1786100591.773401:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74912680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+12:2351:x1872861941784960:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100591.773416:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100591.773423:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac13a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2feb expref: 12 pid: 6686 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.773449:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac13a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2feb expref: 12 pid: 6686 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.773476:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786100591.773481:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786100591.773487:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.773496:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.773530:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100591.773582:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74912680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+12:2351:x1872861941784960:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 182us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100591.773590:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 56 00010000:00010000:1.0:1786100591.773822:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010c87220/0x5564f2c20ac13a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2feb expref: 11 pid: 6686 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100591.773838:0:6684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74911f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1872861960671232:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100591.773862:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.773884:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.773891:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.773901:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.773909:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.773933:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786100591.774448:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1872861960670976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8270us (8624us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1786100591.774456:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786100591.774473:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941784832 00000100:00100000:1.0:1786100591.774478:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941784832 00010000:00010000:2.0:1786100591.774892:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100591.774900:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.774911:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99e00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100591.774916:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.774925:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.774957:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.774975:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de612268/0x5564f2c20ac15ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100591.774996:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100591.774998:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100591.775000:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1786100591.776811:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a3c7fbf9500/2, rc 0, transno 4294967310 00000100:00100000:2.0:1786100591.776823:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960670976:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786100591.777678:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:0.0:1786100591.777698:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+11:2351:x1872861941784832:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1786100591.784286:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786100591.879085:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1786100591.879117:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1786100591.879137:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1786100591.880552:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941784832:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 Request processed in 102852us (108815us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100591.880567:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:3.0:1786100591.889393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100591.889496:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941785216 00000100:00100000:1.0:1786100591.889506:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941785216 00000100:00100000:1.0:1786100591.889560:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 125 00000100:00100000:1.0:1786100591.889569:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+15:10551:x1872861941785216:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786100591.889628:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100591.889806:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac15d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c307e expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.889827:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:1.0:1786100591.889831:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786100591.892860:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac15f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.892881:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac15f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100591.892909:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac15f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786100591.893220:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002241d760 reply state 0000000007e5d615 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac15f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100591.893232:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786100591.893349:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+16:10551:x1872861941785216:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 3776us (3962us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1786100591.893358:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 125 00000100:00100000:2.0:1786100591.903992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100591.904419:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941785344 00000100:00100000:1.0:1786100591.904430:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941785344 00000100:00100000:1.0:1786100591.904493:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:1.0:1786100591.904503:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2352:x1872861941785344:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1786100591.905119:0:9414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1786100591.905123:0:9414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1786100591 -> 1786100590 00002000:00010000:1.0:1786100591.905125:0:9414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1786100590 00002000:00010000:1.0:1786100591.905127:0:9414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1786100591 -> 1786100590 00002000:00010000:1.0:1786100591.905129:0:9414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1786100591.905189:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941785344:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 685us (1204us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1786100591.905197:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 44 00010000:00010000:0.0:1786100591.909815:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac15f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.909832:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac15f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.910089:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac15f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.910096:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100591.910101:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac15f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.910109:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac15f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.910127:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:0.0:1786100591.910130:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100591.910134:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac15f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.910141:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac15f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100591.915983:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100591.916197:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941785600 00000100:00100000:0.0:1786100591.916207:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941785600 00000100:00100000:0.0:1786100591.916267:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 126 00000100:00100000:0.0:1786100591.916278:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+15:10551:x1872861941785600:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1786100591.916345:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.916361:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac15b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3070 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.916370:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.916429:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac15b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3070 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.916443:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac15b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3070 expref: 15 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100591.916459:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74918e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960671360:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100591.916563:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c49d7c240 going to sleep for 11 seconds 00000100:00100000:0.0:1786100591.925496:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74918e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960671360:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100591.925526:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100591.927601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100591.927988:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941785728 00000100:00100000:1.0:1786100591.928000:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941785728 00010000:00010000:1.0:1786100591.928122:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac15b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3070 expref: 16 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100591.928162:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 57 00000100:00100000:1.0:1786100591.928172:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74911500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+16:2351:x1872861941785728:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100591.928187:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100591.928208:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac15b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3070 expref: 16 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.928223:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac15b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3070 expref: 16 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.928248:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac15b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3070 expref: 16 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.928263:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:1.0:1786100591.928268:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.928277:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.928284:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.929155:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100591.929227:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74911500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+15:2351:x1872861941785728:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 1053us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100591.929237:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 57 00010000:00010000:0.0:1786100591.930834:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.930848:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.930891:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.930897:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.930904:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.930910:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100591.930914:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.930934:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.930949:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:0.0:1786100591.930952:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1786100591.930957:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.930977:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac15fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100591.931303:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+14:10551:x1872861941785600:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 Request processed in 15023us (15337us total) trans 0 rc -22/-22 00000100:00100000:0.0:1786100591.931314:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 126 00000100:00100000:3.0:1786100591.944187:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100591.944283:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941785856 00000100:00100000:1.0:1786100591.944293:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941785856 00000100:00100000:1.0:1786100591.944351:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:1.0:1786100591.944363:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:2353:x1872861941785856:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786100591.944406:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.944443:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043c3c4fb/0x5564f2c20ac15de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c308c expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.944451:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786100591.944455:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786100591.944459:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.944493:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043c3c4fb/0x5564f2c20ac15de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c308c expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.944506:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043c3c4fb/0x5564f2c20ac15de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c308c expref: 7 pid: 6686 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100591.944637:0:6683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbf8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1872861960671488:192.168.206.53@tcp:104: 00000100:00100000:1.0:1786100591.944951:0:6683:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47aa9240 going to sleep for 11 seconds 00000100:00100000:1.0:1786100591.957054:0:6683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbf8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1872861960671488:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100591.957094:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100591.958243:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100591.958623:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941785984 00000100:00100000:0.0:1786100591.958632:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941785984 00010000:00010000:0.0:1786100591.958808:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043c3c4fb/0x5564f2c20ac15de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c308c expref: 8 pid: 6686 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100591.958849:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:0.0:1786100591.959024:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941785984:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100591.959039:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100591.959060:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043c3c4fb/0x5564f2c20ac15de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c308c expref: 8 pid: 6686 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.959074:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043c3c4fb/0x5564f2c20ac15de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c308c expref: 8 pid: 6686 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.959116:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043c3c4fb/0x5564f2c20ac15de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c308c expref: 8 pid: 6686 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.959131:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786100591.959136:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786100591.959141:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.959151:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.961187:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100591.961273:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941785984:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 2247us (3028us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100591.961285:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 58 00010000:00010000:1.0:1786100591.965335:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.965353:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.965410:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.965418:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.965425:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.965431:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f000 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100591.965435:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.965443:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.965461:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100591.965469:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f86932af/0x5564f2c20ac1601 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100591.966459:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941785856:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 Request processed in 22091us (22272us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100591.966472:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:0.0:1786100591.989194:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100591.992155:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941786240 00000100:00100000:2.0:1786100591.992168:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941786240 00000100:00100000:0.0:1786100591.995118:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 127 00000100:00100000:0.0:1786100591.995132:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+14:10551:x1872861941786240:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786100591.995212:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1608 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.995230:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.995241:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.995466:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.995478:0:9953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac15c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3077 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.995485:0:9953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.995534:0:9953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac15c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3077 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100591.995547:0:9953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac15c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3077 expref: 15 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100591.995562:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960671616:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100591.995638:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c49d7c240 going to sleep for 11 seconds 00000100:00100000:2.0:1786100592.006283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100592.006362:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941786368 00000100:00100000:3.0:1786100592.006371:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941786368 00010000:00010000:3.0:1786100592.006435:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac15c2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3077 expref: 16 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100592.006533:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:3.0:1786100592.006544:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+16:2352:x1872861941786368:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100592.006560:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100592.006568:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac15c2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3077 expref: 16 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.006581:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac15c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3077 expref: 16 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.006622:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:3.0:1786100592.006627:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.006683:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786100592.006830:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786100592.007284:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.007307:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100592.007375:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+16:2352:x1872861941786368:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 831us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100592.007383:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 59 00010000:00010000:0.0:1786100592.007473:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac15c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3077 expref: 15 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100592.007491:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960671616:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100592.007511:0:9953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.007519:0:9953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.007525:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786100592.007756:0:9953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1786100592.007913:0:9953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1786100592.007957:0:9953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1786100592.008048:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9953:1872861960671744:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786100592.008093:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100592.008120:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c412edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786100592.008146:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960671744 00000100:00100000:0.0:1786100592.008151:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960671744 00000100:00100000:0.0:1786100592.008185:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786100592.008193:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9953:x1872861960671744:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786100592.008273:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9953:x1872861960671744:12345-0@lo:1000:mdt00_003.0 Request processed in 81us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100592.008280:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786100592.008321:0:9953:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1786100592.008326:0:9953:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1786100592.008340:0:9953:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a3c7fbf8000, transno 4294967309 00000004:00080000:0.0:1786100592.008347:0:9953:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a3c7fbf9500, transno 4294967310 00000100:00100000:0.0:1786100592.008351:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9953:1872861960671744:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1786100592.008770:0:9953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1786100592.008818:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9953:1872861960671872:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786100592.008846:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100592.008863:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c412ed900 going to sleep for 11 seconds 00000100:00100000:0.0:1786100592.008876:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960671872 00000100:00100000:0.0:1786100592.008880:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960671872 00000100:00100000:0.0:1786100592.008902:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786100592.008909:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9953:x1872861960671872:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786100592.009062:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9953:x1872861960671872:12345-0@lo:1000:mdt00_003.0 Request processed in 153us (215us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1786100592.009069:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786100592.009101:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9953:1872861960671872:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1786100592.009128:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009137:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009144:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009150:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100592.009154:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009161:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009174:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a3c461b1c00) 00010000:00010000:0.0:1786100592.009177:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786100592.009182:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009187:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac160f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009213:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1552 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009230:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1552 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009235:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1552 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009240:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51fe00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100592.009243:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1552 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009248:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1552 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009257:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:0.0:1786100592.009259:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786100592.009266:0:9953:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac1559 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c305b expref: 18 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009276:0:9953:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac1559 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c305b expref: 18 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009285:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac1559 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c305b expref: 18 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.009308:0:9953:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac1559 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c305b expref: 18 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100592.009319:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74919880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960672000:192.168.206.53@tcp:105: 00000100:00100000:0.0:1786100592.009372:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c411ca840 going to sleep for 11 seconds 00000100:00100000:1.0:1786100592.020902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100592.023397:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74919880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960672000:192.168.206.53@tcp:105: 00010000:00010000:0.0:1786100592.023431:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1552 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.023441:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1552 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024296:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1616 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024315:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1616 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024326:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1616 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024338:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1616 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024345:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1616 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024352:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1616 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024358:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100592.024362:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1616 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024369:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1616 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024399:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:0.0:1786100592.024402:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100592.024406:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1616 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024412:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1616 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024425:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024431:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1608 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024437:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1608 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024442:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbe00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100592.024444:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1608 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024457:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1608 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024464:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:0.0:1786100592.024467:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786100592.024469:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1608 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.024475:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1608 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100592.024658:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941786496 00000100:00100000:2.0:1786100592.024667:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941786496 00000100:00100000:2.0:1786100592.024770:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:2.0:1786100592.024781:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+19:10550:x1872861941786496:12345-192.168.206.53@tcp:49:lfs.0 00000100:00100000:2.0:1786100592.024917:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+19:10550:x1872861941786496:12345-192.168.206.53@tcp:49:lfs.0 Request processed in 138us (4023us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100592.024924:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:0.0:1786100592.025130:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+18:10551:x1872861941786240:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 30000us (35943us total) trans 4294967407 rc 0/0 00000100:00100000:0.0:1786100592.025138:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 127 00000020:00080000:0.0:1786100592.025142:0:9953:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1786100592.025242:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786100592.025247:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786100592.025769:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1786100592.025778:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786100592.050777:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100592.050826:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941786752 00000100:00100000:1.0:1786100592.050837:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941786752 00000100:00100000:1.0:1786100592.050888:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:1.0:1786100592.050898:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6af01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+18:10551:x1872861941786752:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1786100592.051508:0:5847:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1786100592.054255:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:1.0:1786100592.054336:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac161d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100592.054354:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac161d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100592.054365:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac161d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100592.054374:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac161d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100592.054380:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac161d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100592.054386:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac161d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100592.054404:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786100592.054506:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6af01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+20:10551:x1872861941786752:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 3606us (3732us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1786100592.055407:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:0.0:1786100592.056853:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100592.056865:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac161d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.056876:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100592.056880:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac161d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.056890:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac161d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.056906:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a3c461b1300) 00010000:00010000:0.0:1786100592.056909:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786100592.056913:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac161d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.056919:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac161d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100592.056942:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100592.056955:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100592.056956:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100592.057220:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941787008 00000100:00100000:2.0:1786100592.057231:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941787008 00000100:00100000:2.0:1786100592.057293:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 128 00000100:00100000:2.0:1786100592.057311:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+21:10550:x1872861941787008:12345-192.168.206.53@tcp:58:lfs.0 00000100:00100000:1.0:1786100592.058058:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 32 00000020:00080000:1.0:1786100592.058074:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1786100592.060739:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1786100592.060858:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+20:10550:x1872861941787008:12345-192.168.206.53@tcp:58:lfs.0 Request processed in 3545us (5449us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100592.060870:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 128 00000001:00080000:3.0:1786100592.105341:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1786100592.105367:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1786100592.105381:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:0.0:1786100592.112927:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100592.113415:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941787136 00000100:00100000:3.0:1786100592.113427:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941787136 00000100:00100000:3.0:1786100592.113488:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 129 00000100:00100000:3.0:1786100592.113499:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+20:10553:x1872861941787136:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100592.113535:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100592.113556:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1624 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3093 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.113617:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac162b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.113752:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac162b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.113763:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac162b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.113780:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1632 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.113787:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.113794:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.114408:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac1639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.114424:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3054 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.114432:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac1639 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.114469:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3054 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.114484:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3054 expref: 21 pid: 5844 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100592.115295:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960672128:192.168.206.53@tcp:104: 00000100:00100000:3.0:1786100592.115408:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7ce9c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100592.123808:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100592.123865:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960672128:192.168.206.53@tcp:104: 00010000:00010000:3.0:1786100592.123896:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac1639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100592.123997:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941787392 00000100:00100000:0.0:1786100592.124005:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941787392 00000100:00100000:0.0:1786100592.124059:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:0.0:1786100592.124069:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+22:5590:x1872861941787392:12345-192.168.206.53@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786100592.124377:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+23:5590:x1872861941787392:12345-192.168.206.53@tcp:35:ldlm_bl.0 Request processed in 308us (576us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1786100592.124385:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:0.0:1786100592.127846:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100592.128071:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941787520 00000100:00100000:3.0:1786100592.128082:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941787520 00010000:00010000:3.0:1786100592.128133:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3054 expref: 23 pid: 5844 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100592.128177:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:3.0:1786100592.128188:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+23:2351:x1872861941787520:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100592.128203:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100592.128210:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3054 expref: 23 pid: 5844 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.128222:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3054 expref: 23 pid: 5844 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.128247:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1544 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3054 expref: 23 pid: 5844 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.128263:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:3.0:1786100592.128268:0:11178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac1639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.128290:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac1639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.128298:0:11178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac1639 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100592.128336:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100592.128395:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+22:2351:x1872861941787520:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 208us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100592.128402:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 60 00010000:00010000:2.0:1786100592.132246:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac1639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132264:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac1639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100592.132313:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1786100592.132317:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100592.132338:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac1639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132352:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac1639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132361:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac162b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132367:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac162b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132374:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac162b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132380:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100592.132384:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac162b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132411:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac162b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132427:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:2.0:1786100592.132430:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100592.132434:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac162b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132440:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac162b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132454:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132459:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1632 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132465:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132469:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99c00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100592.132472:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132477:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1632 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132483:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a3c454ab900) 00010000:00010000:2.0:1786100592.132485:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100592.132488:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1632 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132501:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1632 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132544:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1624 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3093 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132559:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac1639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3093 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100592.132566:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:2.0:1786100592.132568:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100592.132570:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98600, rc 0) 00000100:00100000:2.0:1786100592.132688:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+21:10553:x1872861941787136:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 19155us (19734us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100592.132697:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 129 00000100:00100000:1.0:1786100592.269181:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100592.269274:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100592.269319:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100592.269354:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941787776 00000100:00100000:1.0:1786100592.269364:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941787776 00000100:00100000:1.0:1786100592.269426:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00100000:1.0:1786100592.269437:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2353:x1872861941787776:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100592.269508:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2353:x1872861941787776:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100592.269515:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00080000:1.0:1786100592.269537:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786100592.271215:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941787904 00000100:00100000:3.0:1786100592.271230:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941787904 00000100:00100000:3.0:1786100592.271306:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 136 00000100:00100000:3.0:1786100592.271316:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3868b77e-5219-4134-824e-d85227fdc483+5:2354:x1872861941787904:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100592.271387:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3868b77e-5219-4134-824e-d85227fdc483+5:2354:x1872861941787904:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 73us (2112us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100592.271394:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 136 00000100:00080000:3.0:1786100592.271523:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100592.272944:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941787648 00000100:00100000:2.0:1786100592.272955:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941787648 00000100:00100000:2.0:1786100592.273307:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 288 00000100:00100000:2.0:1786100592.273318:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2354:x1872861941787648:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100592.273396:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2354:x1872861941787648:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 80us (4303us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100592.273403:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 288 00010000:00010000:2.0:1786100592.805741:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786100592.942266:0:12065:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786100592.942276:0:12065:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786100592.942324:0:12065:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1786100592.942329:0:12065:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1786100593.061135:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786100593.061144:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786100593.061203:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1786100593.061210:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786100593.061334:0:11696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1872861960672256:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786100593.061430:0:11696:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c45810b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786100593.065642:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100593.065757:0:11696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1872861960672256:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786100593.070968:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941788032 00000100:00100000:0.0:1786100593.070983:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941788032 00000100:00100000:0.0:1786100593.071110:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 130 00000100:00100000:0.0:1786100593.071123:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+21:10566:x1872861941788032:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786100593.071164:0:9953:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786100593.071280:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+21:10566:x1872861941788032:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 160us (5646us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100593.071289:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 130 00000100:00100000:1.0:1786100593.076345:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100593.076714:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941788288 00000100:00100000:3.0:1786100593.076724:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941788288 00000100:00100000:3.0:1786100593.076789:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 131 00000100:00100000:3.0:1786100593.076799:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+21:10566:x1872861941788288:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786100593.076829:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100593.076848:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1640 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c309a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100593.076941:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1647 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100593.076965:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100593.076977:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100593.076988:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1786100593.077105:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1640 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c309a expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100593.077123:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1647 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c309a expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100593.077132:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:3.0:1786100593.077135:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786100593.077138:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99400, rc 0) 00000100:00100000:3.0:1786100593.077194:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+23:10566:x1872861941788288:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 396us (858us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1786100593.077201:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 131 00000100:00100000:1.0:1786100593.085075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100593.085190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100593.086221:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941788672 00000100:00100000:2.0:1786100593.086234:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941788672 00000100:00100000:2.0:1786100593.086305:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:2.0:1786100593.086316:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+23:2353:x1872861941788672:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100593.086339:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100593.086365:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1647 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c309a expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100593.086384:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:2.0:1786100593.086389:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100593.086447:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+22:2353:x1872861941788672:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 133us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100593.086456:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:0.0:1786100593.090191:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941788544 00000100:00100000:0.0:1786100593.090204:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941788544 00000100:00100000:0.0:1786100593.090281:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 132 00000100:00100000:0.0:1786100593.090293:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+22:10566:x1872861941788544:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786100593.090370:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1655 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100593.090385:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100593.090396:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100593.090568:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100593.090575:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1655 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100593.090581:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100593.090587:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbba00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100593.090591:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100593.090597:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1655 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100593.090610:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:0.0:1786100593.090613:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786100593.090616:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1655 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100593.090632:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1655 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100593.090815:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+23:10566:x1872861941788544:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 524us (5623us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1786100593.090823:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 132 00000040:00080000:1.0:1786100593.091115:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786100593.091120:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786100593.091597:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1786100593.091605:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786100593.097268:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100593.097322:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941788928 00000100:00100000:3.0:1786100593.097332:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941788928 00000100:00100000:3.0:1786100593.097398:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:3.0:1786100593.097413:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+23:10566:x1872861941788928:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786100593.097704:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+24:10566:x1872861941788928:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 297us (448us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1786100593.097713:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 34 00010000:00010000:2.0:1786100593.828888:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786100594.791265:0:12117:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786100594.791273:0:12117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786100594.791314:0:12117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1786100594.791320:0:12117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786100594.852812:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100594.947446:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100594.949882:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941789184 00000100:00100000:2.0:1786100594.949895:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941789184 00000100:00100000:2.0:1786100594.950089:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 133 00000100:00100000:2.0:1786100594.950102:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+24:10586:x1872861941789184:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100594.950136:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100594.950156:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac165c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30a1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100594.950247:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e600/0x5564f2c20ac1663 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100594.950262:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e600/0x5564f2c20ac1663 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100594.950273:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e600/0x5564f2c20ac1663 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100594.950283:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1786100594.950407:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac165c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30a1 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100594.950423:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e600/0x5564f2c20ac1663 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30a1 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100594.950432:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:2.0:1786100594.950435:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1786100594.950438:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51e600, rc 0) 00000100:00100000:2.0:1786100594.950503:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+26:10586:x1872861941789184:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 404us (3066us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1786100594.950510:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 133 00000100:00080000:1.0:1786100594.950784:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100594.955394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100594.955702:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941789312 00000100:00100000:0.0:1786100594.955712:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941789312 00000100:00100000:0.0:1786100594.955768:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 134 00000100:00100000:0.0:1786100594.955779:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+26:10586:x1872861941789312:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:0.0:1786100594.955847:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100594.955863:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100594.955875:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100594.955901:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100594.955908:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1671 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100594.955914:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100594.955921:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbae00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100594.955934:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100594.955941:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1671 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100594.955969:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:0.0:1786100594.955972:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786100594.955977:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1671 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100594.955984:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100594.956056:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+26:10586:x1872861941789312:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 279us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100594.956063:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 134 00000100:00100000:0.0:1786100595.041726:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100595.041817:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941789440 00000100:00100000:1.0:1786100595.041893:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941789440 00000100:00100000:1.0:1786100595.042015:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:1.0:1786100595.042027:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941789440:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:1.0:1786100595.042045:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100595.042065:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026774584/0x5564f2c20ac1678 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30a8 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786100595.042092:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a75bb6e, atime: 0x6a75bb6e, ctime: 0x6a75bb6e, blocks: 0xb 00010000:00010000:1.0:1786100595.042112:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1786100595.042116:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100595.042126:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026774584/0x5564f2c20ac1678 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30a8 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100595.042144:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026774584/0x5564f2c20ac1678 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30a8 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100595.042158:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165ec00, rc 0) 00000100:00100000:1.0:1786100595.042219:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+7:2354:x1872861941789440:12345-192.168.206.53@tcp:101:cat.0 Request processed in 195us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100595.042227:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00080000:3.0:1786100595.043936:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786100595.045318:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100595.045391:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941789568 00000100:00100000:3.0:1786100595.045400:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941789568 00002000:00100000:3.0:1786100595.045444:0:6689:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9a3c44f79500 x1872861941789568/t0(0) o3->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:126/0 lens 488/0 e 0 to 0 dl 1786100606 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786100595.045455:0:6689:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c44f79500 with x1872861941789568 ext(0->4095) 00002000:00010000:3.0:1786100595.045461:0:6689:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c44f79500 00000100:00100000:3.0:1786100595.045493:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:3.0:1786100595.045504:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:2353:x1872861941789568:12345-192.168.206.53@tcp:3:cat.0 00000100:00100000:3.0:1786100595.045779:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:2353:x1872861941789568:12345-192.168.206.53@tcp:3:cat.0 Request processed in 276us (465us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786100595.045787:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 3 00002000:00100000:3.0:1786100595.045794:0:6689:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9a3c44f79500 x1872861941789568/t0(0) o3->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:126/0 lens 488/4536 e 0 to 0 dl 1786100606 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786100595.045802:0:6689:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c44f79500 with x1872861941789568 ext(0->4095) 00002000:00010000:3.0:1786100595.045806:0:6689:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c44f79500 00000100:00100000:2.0:1786100595.108924:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960672512:0@lo:400:kworker.0 00000100:00100000:3.0:1786100595.108959:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960672640:0@lo:400:kworker.0 00000100:00100000:2.0:1786100595.109009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100595.109067:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6e02aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960673024:0@lo:400:kworker.0 00000100:00100000:2.0:1786100595.109092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100595.109134:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960672512 00000100:00100000:2.0:1786100595.109140:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100595.109154:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960672512 00000100:00100000:2.0:1786100595.109169:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960672640 00000100:00100000:2.0:1786100595.109175:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960672640 00000100:00100000:3.0:1786100595.109203:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1786100595.109213:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960672512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100595.109234:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1786100595.109246:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960672640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100595.109273:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960672512:12345-0@lo:400:kworker.0 Request processed in 60us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100595.109281:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1786100595.109299:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960672640:12345-0@lo:400:kworker.0 Request processed in 56us (157us total) trans 0 rc 0/0 00000100:00080000:3.0:1786100595.109306:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100595.109307:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1786100595.109352:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960672640:0@lo:400:kworker.0 00000100:00100000:3.0:1786100595.109358:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960672512:0@lo:400:kworker.0 00000100:00100000:1.0:1786100595.109568:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960672768:0@lo:400:kworker.0 00000100:00100000:1.0:1786100595.109601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100595.109630:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786100595.109636:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960672384:0@lo:400:kworker.0 00000100:00100000:1.0:1786100595.109695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100595.109725:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960672896:0@lo:400:kworker.0 00000100:00100000:1.0:1786100595.109746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100595.109770:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960673024 00000100:00100000:1.0:1786100595.109774:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960673024 00000100:00100000:1.0:1786100595.109801:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960672768 00000100:00100000:1.0:1786100595.109804:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960672768 00000100:00100000:1.0:1786100595.109822:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786100595.109828:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1872861960673024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100595.109862:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1872861960673024:12345-0@lo:400:kworker.0 Request processed in 34us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100595.109868:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786100595.109879:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1786100595.109884:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960672768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100595.109913:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960672768:12345-0@lo:400:kworker.0 Request processed in 28us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100595.109918:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1786100595.109962:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1786100595.109967:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1786100595.109981:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a3c45165180, transno 4294967301 00000004:00080000:1.0:1786100595.109988:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1786100595.110004:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a3c74910380, transno 4294967304 00000100:00100000:1.0:1786100595.110009:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960672768:0@lo:400:kworker.0 00000100:00100000:0.0:1786100595.110205:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960672896 00000100:00100000:0.0:1786100595.110210:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960672896 00000100:00100000:0.0:1786100595.110246:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1786100595.110254:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960672896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100595.110292:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960672896:12345-0@lo:400:kworker.0 Request processed in 40us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100595.110298:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1786100595.110428:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960672896:0@lo:400:kworker.0 00000100:00100000:3.0:1786100595.111576:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960672384 00000100:00100000:3.0:1786100595.111585:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960672384 00000100:00100000:3.0:1786100595.111639:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1786100595.111647:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960672384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100595.111754:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960672384:12345-0@lo:400:kworker.0 Request processed in 107us (2058us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100595.111760:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:3.0:1786100595.112055:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786100595.112061:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786100595.112063:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786100595.112100:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6e02aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960673024:0@lo:400:kworker.0 00000100:00100000:1.0:1786100595.113120:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960672384:0@lo:400:kworker.0 00000100:00100000:3.0:1786100595.621379:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c45167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960673152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100595.621449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100595.621642:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960673152 00000100:00100000:1.0:1786100595.621672:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960673152 00000100:00100000:1.0:1786100595.621736:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1786100595.621746:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1872861960673152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100595.621782:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100595.621830:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1872861960673152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100595.621837:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786100595.621997:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786100595.622009:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6e029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960673280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100595.622041:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100595.622131:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960673280 00000100:00100000:3.0:1786100595.622228:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960673280 00000100:00100000:3.0:1786100595.622263:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786100595.622270:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960673280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786100595.622290:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100595.622331:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960673280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100595.622338:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786100595.622379:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6e029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960673280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100595.622411:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c45167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960673152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786100595.880115:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100596.900953:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786100597.209844:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1786100597.209865:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1786100597.235105:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:1.0:1786100597.235121:0:5865:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a3c412edd80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1786100597.235126:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c45907e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c412ed3c0 00000020:00080000:1.0:1786100597.235129:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c45907500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c4736d800 00000020:00080000:1.0:1786100597.235156:0:5865:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1786100597.235161:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1786100597.235183:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1786100597.235447:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1786100597.388174:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100597.388216:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100597.388249:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100597.388276:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100597.388303:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100597.388335:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941790208 00000100:00100000:3.0:1786100597.388340:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941789824 00000100:00100000:0.0:1786100597.388344:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941790208 00000100:00100000:3.0:1786100597.388348:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941789824 00000100:00100000:1.0:1786100597.388412:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941789952 00000100:00100000:1.0:1786100597.388418:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941789952 00000100:00100000:0.0:1786100597.388504:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 140 00000100:00100000:2.0:1786100597.388834:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941789696 00000100:00100000:2.0:1786100597.388839:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941789696 00000100:00100000:2.0:1786100597.388871:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 290 00000100:00100000:2.0:1786100597.388879:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2354:x1872861941789696:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100597.388956:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2354:x1872861941789696:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 77us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100597.388963:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 290 00000100:00080000:1.0:1786100597.391525:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786100597.391536:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100597.391618:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941790080 00000100:00100000:2.0:1786100597.391627:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941790080 00000100:00100000:2.0:1786100597.391677:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:2.0:1786100597.391690:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941789952:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100597.391753:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941789952:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 67us (3536us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100597.391761:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:2.0:1786100597.391778:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:2.0:1786100597.391785:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941790080:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100597.391807:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941790080:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 24us (3504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100597.391812:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:0.0:1786100597.395215:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2354:x1872861941790208:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100597.395363:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2354:x1872861941790208:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 6849us (7112us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100597.395374:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 140 00000100:00080000:1.0:1786100597.395534:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786100597.396104:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 141 00000100:00100000:2.0:1786100597.396233:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b429ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+13:2354:x1872861941789824:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100597.396319:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b429ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+13:2354:x1872861941789824:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 206us (8042us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100597.396326:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 141 00010000:00010000:1.0:1786100597.932583:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100598.955875:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100599.973242:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100599.981394:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100599.982153:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941790336 00000100:00100000:1.0:1786100599.982164:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941790336 00000100:00100000:1.0:1786100599.982237:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 135 00000100:00100000:1.0:1786100599.982247:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e02ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+13:10239:x1872861941790336:12345-192.168.206.53@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1786100599.982338:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e02ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+13:10239:x1872861941790336:12345-192.168.206.53@tcp:60:lhsmtool_posix.0 Request processed in 92us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100599.982345:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 135 00000100:00080000:2.0:1786100599.983009:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100599.991759:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100599.993895:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941790592 00000100:00100000:2.0:1786100599.993909:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941790592 00000100:00100000:2.0:1786100599.993983:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:2.0:1786100599.993994:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+13:10239:x1872861941790592:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786100599.994453:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+14:10239:x1872861941790592:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 459us (2703us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1786100599.994461:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:2.0:1786100600.229183:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960673536:0@lo:400:kworker.0 00000100:00100000:2.0:1786100600.229252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100600.229316:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960674048:0@lo:400:kworker.0 00000100:00100000:2.0:1786100600.229342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100600.229376:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786100600.229383:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960673664:0@lo:400:kworker.0 00000100:00100000:2.0:1786100600.229408:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100600.229438:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960674048 00000100:00100000:2.0:1786100600.229444:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960674048 00000100:00100000:2.0:1786100600.229574:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1786100600.229585:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e02aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960674048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100600.229638:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e02aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960674048:12345-0@lo:400:kworker.0 Request processed in 54us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100600.229646:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1786100600.229684:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960673792:0@lo:400:kworker.0 00000100:00100000:2.0:1786100600.229697:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960673536 00000100:00100000:2.0:1786100600.229709:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960673536 00000100:00100000:1.0:1786100600.229720:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100600.229741:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960673664 00000100:00100000:2.0:1786100600.229746:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960673664 00000100:00100000:1.0:1786100600.229748:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786100600.229757:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960673408:0@lo:400:kworker.0 00000100:00100000:2.0:1786100600.229769:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1786100600.229779:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960673536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100600.229786:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100600.229816:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960673920:0@lo:400:kworker.0 00000100:00100000:2.0:1786100600.229824:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960673536:12345-0@lo:400:kworker.0 Request processed in 47us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100600.229832:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1786100600.229844:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100600.229848:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960673920 00000100:00100000:2.0:1786100600.229854:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960673920 00000100:00100000:1.0:1786100600.229868:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960673792 00000100:00100000:1.0:1786100600.229873:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960673792 00000100:00100000:2.0:1786100600.229878:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1786100600.229888:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960673664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100600.229928:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1786100600.229937:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960673792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100600.229973:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960673792:12345-0@lo:400:kworker.0 Request processed in 37us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100600.229980:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1786100600.230010:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960673408 00000100:00100000:1.0:1786100600.230013:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960673408 00000100:00080000:3.0:1786100600.230028:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786100600.230036:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786100600.230040:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786100600.230041:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1786100600.230049:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960673408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100600.230076:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960673408:12345-0@lo:400:kworker.0 Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100600.230082:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1786100600.230107:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960673664:12345-0@lo:400:kworker.0 Request processed in 219us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100600.230115:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1786100600.230130:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960673408:0@lo:400:kworker.0 00000100:00100000:2.0:1786100600.230135:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1786100600.230145:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960673920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100600.230147:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960673792:0@lo:400:kworker.0 00000100:00100000:2.0:1786100600.230193:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960673920:12345-0@lo:400:kworker.0 Request processed in 50us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100600.230198:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960673920:0@lo:400:kworker.0 00000100:00100000:2.0:1786100600.230204:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1786100600.236467:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960673664:0@lo:400:kworker.0 00000100:00100000:3.0:1786100600.236486:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960673536:0@lo:400:kworker.0 00000100:00100000:3.0:1786100600.236497:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1786100600.236501:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1786100600.236521:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960674048:0@lo:400:kworker.0 00000100:00100000:1.0:1786100600.316957:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100600.317090:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941790720 00000100:00100000:2.0:1786100600.317100:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941790720 00000100:00100000:2.0:1786100600.317178:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 136 00000100:00100000:2.0:1786100600.317188:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+5:11039:x1872861941790720:12345-192.168.206.53@tcp:101:lsof.0 00010000:00010000:2.0:1786100600.317208:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100600.317228:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac167f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30af expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100600.317304:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1686 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100600.317318:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100600.317331:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100600.317533:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1786100600.317537:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100600.317626:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100600.317678:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac167f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30af expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100600.317695:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1686 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30af expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100600.317703:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454ab600) 00010000:00010000:2.0:1786100600.317707:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786100600.317710:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f800, rc 0) 00000100:00100000:2.0:1786100600.317768:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+6:11039:x1872861941790720:12345-192.168.206.53@tcp:101:lsof.0 Request processed in 581us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100600.317774:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 136 00000100:00080000:3.0:1786100600.318139:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100600.742041:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786100600.742063:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960674176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100600.742128:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100600.742271:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960674176 00000100:00100000:1.0:1786100600.742278:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960674176 00000100:00100000:1.0:1786100600.742330:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786100600.742340:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960674176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100600.742371:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100600.742414:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960674176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100600.742421:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1786100600.742510:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960674176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100600.742810:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786100600.742822:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960674304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100600.742853:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100600.742964:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960674304 00000100:00100000:0.0:1786100600.742969:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960674304 00000100:00100000:0.0:1786100600.743002:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1786100600.743008:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960674304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786100600.743038:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100600.743083:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960674304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100600.743089:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1786100600.744041:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960674304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786100601.004780:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786100601.318193:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786100601.318201:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786100601.318476:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1786100601.318483:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786100602.021004:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1786100602.331007:0:5865:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1786100602.331161:0:12187:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1786100602.333002:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1786100602.333017:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1786100602.504092:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100602.504250:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941790848 00000100:00100000:2.0:1786100602.504260:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941790848 00000100:00100000:2.0:1786100602.504328:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 292 00000100:00100000:2.0:1786100602.504339:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2352:x1872861941790848:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100602.504416:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2352:x1872861941790848:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 78us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100602.504424:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 292 00000100:00100000:0.0:1786100602.504991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100602.505095:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941791104 00000100:00100000:2.0:1786100602.505100:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941791104 00000100:00100000:2.0:1786100602.505154:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 84 00000100:00100000:2.0:1786100602.505162:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+5:2352:x1872861941791104:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100602.505199:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+5:2352:x1872861941791104:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 39us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100602.505206:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 84 00000100:00080000:3.0:1786100602.505682:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786100602.507813:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100602.507850:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100602.507886:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100602.508022:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941791360 00000100:00100000:3.0:1786100602.508033:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941791360 00000100:00100000:3.0:1786100602.508088:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941790976 00000100:00100000:3.0:1786100602.508091:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941790976 00000100:00100000:3.0:1786100602.508130:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 145 00000100:00100000:3.0:1786100602.508140:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3868b77e-5219-4134-824e-d85227fdc483+6:2352:x1872861941791360:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100602.508206:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3868b77e-5219-4134-824e-d85227fdc483+6:2352:x1872861941791360:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 67us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100602.508213:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 145 00000100:00100000:3.0:1786100602.508230:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 146 00000100:00100000:3.0:1786100602.508237:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+13:2352:x1872861941790976:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100602.508264:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+13:2352:x1872861941790976:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100602.508270:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 146 00000100:00100000:2.0:1786100602.508451:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941791232 00000100:00100000:2.0:1786100602.508456:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941791232 00000100:00100000:2.0:1786100602.508503:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00100000:2.0:1786100602.508511:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2352:x1872861941791232:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100602.508540:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2352:x1872861941791232:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 30us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100602.508548:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00080000:0.0:1786100602.508673:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786100602.508678:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786100603.046497:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786100603.496401:0:12320:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 07:03:21 (1786100601) 00010000:00010000:1.0:1786100604.068907:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100604.754213:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100604.754390:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941791616 00000100:00100000:3.0:1786100604.754402:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941791616 00000100:00100000:3.0:1786100604.754492:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 137 00000100:00100000:3.0:1786100604.754505:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+13:11304:x1872861941791616:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786100604.754532:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100604.754558:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac168d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30b6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.754703:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1694 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.754720:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1694 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.754734:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1694 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.754770:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac169b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.754779:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac169b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.754785:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac169b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755312:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac16a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755324:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac16a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755332:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac16a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100604.755342:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1786100604.755560:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1694 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755569:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1694 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755576:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1694 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755583:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99a00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100604.755588:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1694 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755606:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1694 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755620:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a3c433df100) 00010000:00010000:3.0:1786100604.755623:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100604.755628:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1694 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755635:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1694 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755648:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac169b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755703:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac169b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755709:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac169b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755714:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100604.755717:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac169b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755723:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac169b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755729:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a3c454ab900) 00010000:00010000:3.0:1786100604.755732:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100604.755734:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac169b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.755749:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac169b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.756181:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac168d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30b6 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.756196:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac16a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30b6 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100604.756205:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df900) 00010000:00010000:3.0:1786100604.756207:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100604.756210:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99e00, rc 0) 00000100:00100000:3.0:1786100604.756281:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+15:11304:x1872861941791616:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 1779us (2085us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1786100604.756290:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 137 00000100:00080000:0.0:1786100604.756739:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100604.761580:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100604.761626:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100604.761762:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941791872 00000100:00100000:1.0:1786100604.761775:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941791872 00000100:00100000:1.0:1786100604.761850:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:1.0:1786100604.761867:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+15:2351:x1872861941791872:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100604.761908:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100604.761942:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac16a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30b6 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100604.761968:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df900) 00010000:00010000:1.0:1786100604.761975:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100604.762053:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+14:2351:x1872861941791872:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 193us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100604.762062:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:2.0:1786100604.763935:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941791744 00000100:00100000:2.0:1786100604.763950:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941791744 00000100:00100000:2.0:1786100604.764341:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 138 00000100:00100000:2.0:1786100604.764356:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+14:11304:x1872861941791744:12345-192.168.206.53@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1786100604.771196:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+14:11304:x1872861941791744:12345-192.168.206.53@tcp:59:lhsmtool_posix.0 Request processed in 6827us (9612us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100604.771216:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 138 00010000:00010000:2.0:1786100605.093152:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100605.350789:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960674816:0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.350876:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100605.350956:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786100605.350963:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960674432:0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.350998:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100605.351024:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960674944:0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.351052:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100605.351083:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960674560:0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.351108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100605.351127:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960675072:0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.351161:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100605.351182:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786100605.351188:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960674688:0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.351226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100605.351265:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960674816 00000100:00100000:3.0:1786100605.351273:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960674816 00000100:00100000:3.0:1786100605.351333:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960675072 00000100:00100000:3.0:1786100605.351337:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960675072 00000100:00100000:3.0:1786100605.351362:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1786100605.351373:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960674816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.351432:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960674816:12345-0@lo:400:kworker.0 Request processed in 61us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100605.351440:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1786100605.351458:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1786100605.351464:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960675072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.351497:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960675072:12345-0@lo:400:kworker.0 Request processed in 33us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100605.351504:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1786100605.351523:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960674432 00000100:00100000:3.0:1786100605.351527:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960674432 00000100:00100000:3.0:1786100605.351553:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1786100605.351559:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960674432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.351588:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960674432:12345-0@lo:400:kworker.0 Request processed in 29us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100605.351593:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1786100605.351621:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960674944 00000100:00100000:3.0:1786100605.351625:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960674944 00000100:00100000:3.0:1786100605.351683:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960674560 00000100:00100000:3.0:1786100605.351687:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960674560 00000100:00100000:3.0:1786100605.351700:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960674688 00000100:00100000:3.0:1786100605.351702:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960674688 00000100:00100000:3.0:1786100605.351717:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1786100605.351723:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960674944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.351755:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960674944:12345-0@lo:400:kworker.0 Request processed in 32us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100605.351762:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1786100605.351773:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1786100605.351779:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960674560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.351807:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960674560:12345-0@lo:400:kworker.0 Request processed in 29us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100605.351813:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1786100605.351824:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1786100605.351830:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960674688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.351858:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960674688:12345-0@lo:400:kworker.0 Request processed in 28us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100605.351864:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1786100605.351904:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786100605.351910:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786100605.351912:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786100605.351958:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960674688:0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.351969:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960674560:0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.351978:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960675072:0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.352013:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960674432:0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.352035:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960674944:0@lo:400:kworker.0 00000100:00100000:3.0:1786100605.352045:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960674816:0@lo:400:kworker.0 00000040:00080000:1.0:1786100605.413703:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786100605.413717:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786100605.413758:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1786100605.413766:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786100605.862413:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960675200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100605.862516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100605.862987:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960675200 00000100:00100000:2.0:1786100605.862996:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960675200 00000100:00100000:2.0:1786100605.863071:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1786100605.863082:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960675200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786100605.863126:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100605.863186:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960675200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100605.863193:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786100605.863377:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960675328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100605.863415:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100605.863490:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960675200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100605.863623:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960675328 00000100:00100000:1.0:1786100605.863628:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960675328 00000100:00100000:1.0:1786100605.863690:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786100605.863699:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960675328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100605.863792:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100605.863835:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960675328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100605.863843:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786100605.864054:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960675328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786100606.116942:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100606.773355:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100606.773415:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941792000 00000100:00100000:3.0:1786100606.773425:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941792000 00000100:00100000:3.0:1786100606.773500:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 139 00000100:00100000:3.0:1786100606.773511:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+14:11346:x1872861941792000:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100606.773531:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100606.773550:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac16b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30bd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.773608:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.773621:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.773634:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.773646:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.773687:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.773695:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.773951:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.773960:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.773967:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.773974:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100606.774172:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.774182:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.774195:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454ab600) 00010000:00010000:3.0:1786100606.774198:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100606.774202:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.774209:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.774221:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.774233:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.774239:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.774245:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99a00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100606.774248:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.774255:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.774263:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a3c454ab900) 00010000:00010000:3.0:1786100606.774265:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100606.774268:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.774274:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.774306:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac16b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30bd expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.774316:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454ab600) 00010000:00010000:3.0:1786100606.774319:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100606.774323:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac16b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30bd expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.774332:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99000, rc 0) 00000100:00080000:0.0:1786100606.774451:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100606.774484:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+14:11346:x1872861941792000:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 973us (1135us total) trans 0 rc 301/301 00000100:00100000:3.0:1786100606.774492:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 139 00000100:00100000:3.0:1786100606.789088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100606.789223:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941792256 00000100:00100000:2.0:1786100606.789233:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941792256 00000100:00100000:2.0:1786100606.789293:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 140 00000100:00100000:2.0:1786100606.789303:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+14:11346:x1872861941792256:12345-192.168.206.53@tcp:36:lfs.0 00010000:00010000:2.0:1786100606.789356:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100606.789384:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac102e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ef6 expref: 14 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.789400:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454ab600) 00010000:00010000:2.0:1786100606.789406:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100606.789705:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.789719:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1686 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30af expref: 5 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.789735:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.789770:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1686 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30af expref: 5 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.789784:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1686 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30af expref: 5 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100606.789800:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960675456:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100606.789898:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100606.794954:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100606.794999:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941792384 00000100:00100000:3.0:1786100606.795007:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941792384 00010000:00010000:3.0:1786100606.795056:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1686 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30af expref: 6 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100606.795088:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:3.0:1786100606.795098:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74861c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3868b77e-5219-4134-824e-d85227fdc483+6:2351:x1872861941792384:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100606.795113:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100606.795120:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1686 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30af expref: 6 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.795134:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1686 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30af expref: 6 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.795159:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454ab600) 00010000:00010000:3.0:1786100606.795165:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.795174:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.795182:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.795220:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100606.795270:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74861c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3868b77e-5219-4134-824e-d85227fdc483+6:2351:x1872861941792384:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 173us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100606.795279:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00080000:3.0:1786100606.795301:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786100606.795847:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1686 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30af expref: 5 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100606.795866:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960675456:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100606.795901:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.795912:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.795918:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.795943:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac16cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.795953:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac16cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.795969:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac16cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100606.799137:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1786100606.799161:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.799174:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.799184:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.799192:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51fc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100606.799197:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.799205:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.799229:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c454ab600) 00010000:00010000:2.0:1786100606.799232:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100606.799237:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100606.799245:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac16c5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100606.799268:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e486d936 reply state 00000000ea327204 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac16cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100606.799291:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786100606.799393:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+15:11346:x1872861941792256:12345-192.168.206.53@tcp:36:lfs.0 Request processed in 10088us (10311us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1786100606.799402:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 140 00010000:00010000:3.0:1786100606.807804:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac16cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.807821:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac16cc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.807829:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac16cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.807836:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100606.807840:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac16cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.807848:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac16cc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.807865:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a3c58043800) 00010000:00010000:3.0:1786100606.807869:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100606.807873:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac16cc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100606.807891:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac16cc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100606.951149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100606.951548:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941792512 00000100:00100000:1.0:1786100606.951557:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941792512 00000100:00100000:1.0:1786100606.951612:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 141 00000100:00100000:1.0:1786100606.951621:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+14:11354:x1872861941792512:12345-192.168.206.53@tcp:101:lctl.0 00010000:00010000:1.0:1786100606.951645:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100606.951713:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac16d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30c4 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100606.951783:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac16da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100606.951795:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac16da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100606.951805:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac16da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100606.951863:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786100606.951874:0:9953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100606.951919:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac16da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100606.951945:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac16d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30c4 expref: 16 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100606.951964:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac16da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30c4 expref: 15 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100606.952089:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:1.0:1786100606.952093:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100606.952097:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f200, rc 0) 00000100:00100000:1.0:1786100606.952161:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+15:11354:x1872861941792512:12345-192.168.206.53@tcp:101:lctl.0 Request processed in 541us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100606.952168:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 141 00000100:00100000:0.0:1786100607.055276:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100607.056733:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941792640 00000100:00100000:3.0:1786100607.056754:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941792640 00000100:00100000:3.0:1786100607.056853:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 142 00000100:00100000:3.0:1786100607.056865:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+15:11360:x1872861941792640:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1786100607.056909:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100607.056935:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac16e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30cb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057037:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057054:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057068:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057086:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057092:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057099:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057258:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac16f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057267:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac16f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057297:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac16f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100607.057338:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1786100607.057342:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786100607.057371:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac16f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057386:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057393:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057401:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057409:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99a00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100607.057414:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057423:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057437:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:3.0:1786100607.057440:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100607.057446:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057453:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac16e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057480:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057487:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057505:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057511:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100607.057514:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057521:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057529:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a3c454ab900) 00010000:00010000:3.0:1786100607.057532:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100607.057535:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057540:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac16ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057579:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac16e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30cb expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057593:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac16f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30cb expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.057613:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:3.0:1786100607.057616:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786100607.057618:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98200, rc 0) 00000100:00100000:3.0:1786100607.057784:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+16:11360:x1872861941792640:12345-192.168.206.53@tcp:101:bash.0 Request processed in 918us (2515us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100607.057792:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 142 00000100:00100000:2.0:1786100607.068684:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100607.068839:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941792896 00000100:00100000:1.0:1786100607.068849:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941792896 00000100:00100000:1.0:1786100607.068926:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 143 00000100:00100000:1.0:1786100607.068939:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+16:11360:x1872861941792896:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:1.0:1786100607.068962:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100607.068997:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac16fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30d2 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.069148:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1704 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.069165:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1704 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.069193:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1704 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.069247:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac170b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.069254:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac170b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.069260:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac170b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786100607.069841:0:9953:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1786100607.070020:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1712 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.070031:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.070040:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.070074:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1704 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.070081:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1704 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.070088:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1704 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.070094:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100607.070104:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1704 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.070112:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1704 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.070125:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:1.0:1786100607.070128:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100607.070133:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1704 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.070139:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1704 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786100607.070153:0:9953:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec7ac32a reply state 000000001d4cdfd2 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac170b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100607.070162:0:9953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786100607.070193:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac16fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d2 expref: 19 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.070207:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d2 expref: 18 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.070215:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1d00) 00010000:00010000:1.0:1786100607.070218:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786100607.070221:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165e400, rc 0) 00000100:00100000:1.0:1786100607.070296:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+19:11360:x1872861941792896:12345-192.168.206.53@tcp:101:bash.0 Request processed in 1359us (1651us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1786100607.070305:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 143 00010000:00010000:3.0:1786100607.074049:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac170b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.074065:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac170b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.074072:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac170b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.074079:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fa00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100607.074083:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac170b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.074091:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac170b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.074107:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c461b1c00) 00010000:00010000:3.0:1786100607.074109:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100607.074113:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac170b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.074119:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac170b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100607.077399:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100607.077770:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941793024 00000100:00100000:3.0:1786100607.077780:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941793024 00000100:00100000:3.0:1786100607.077853:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:3.0:1786100607.077864:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941793024:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1786100607.077893:0:9414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100607.077914:0:9414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006376d837/0x5564f2c20ac1720 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30d9 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786100607.077949:0:9414:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786100607.078069:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1786100607.078075:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100607.078084:0:9414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006376d837/0x5564f2c20ac1720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d9 expref: 6 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.078104:0:9414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006376d837/0x5564f2c20ac1720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d9 expref: 6 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.078116:0:9414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99000, rc 0) 00000100:00100000:3.0:1786100607.078168:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941793024:12345-192.168.206.53@tcp:101:bash.0 Request processed in 307us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100607.078176:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00080000:0.0:1786100607.078327:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786100607.082641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100607.082802:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941793152 00000100:00100000:3.0:1786100607.082814:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941793152 00000100:00100000:3.0:1786100607.082885:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:3.0:1786100607.082895:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:11360:x1872861941793152:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:3.0:1786100607.082936:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100607.082961:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac1727 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30e0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.082991:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006376d837/0x5564f2c20ac1720 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d9 expref: 7 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.083001:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100607.083005:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100607.083011:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac1727 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e0 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.083043:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006376d837/0x5564f2c20ac1720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d9 expref: 7 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.083057:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006376d837/0x5564f2c20ac1720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d9 expref: 7 pid: 9414 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100607.083073:0:6684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74862680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1872861960675584:192.168.206.53@tcp:104: 00000100:00100000:3.0:1786100607.083162:0:6684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47aa9240 going to sleep for 11 seconds 00000100:00100000:3.0:1786100607.088076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100607.090256:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941793280 00000100:00100000:0.0:1786100607.090270:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941793280 00010000:00010000:0.0:1786100607.090370:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006376d837/0x5564f2c20ac1720 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d9 expref: 8 pid: 9414 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100607.090435:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:0.0:1786100607.090446:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74863800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+8:2351:x1872861941793280:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100607.090461:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100607.090484:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006376d837/0x5564f2c20ac1720 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d9 expref: 8 pid: 9414 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.090516:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006376d837/0x5564f2c20ac1720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d9 expref: 8 pid: 9414 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.090542:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100607.090546:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100607.090554:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac1727 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e0 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.090565:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac1727 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e0 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.090600:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac1727 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e0 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100607.090615:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1872861960675712:192.168.206.53@tcp:105: 00000100:00100000:0.0:1786100607.090730:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74900240 going to sleep for 11 seconds 00000100:00100000:0.0:1786100607.094383:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1872861960675712:192.168.206.53@tcp:105: 00010000:00010000:0.0:1786100607.094602:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100607.094694:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74863800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+8:2351:x1872861941793280:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 4249us (6625us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100607.094705:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 62 00010000:00010000:2.0:1786100607.096223:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006376d837/0x5564f2c20ac1720 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d9 expref: 7 pid: 9414 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100607.096245:0:6684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74862680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1872861960675584:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100607.096276:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac1727 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e0 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100607.096290:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98800, rc 0) 00000100:00100000:2.0:1786100607.096346:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:11360:x1872861941793152:12345-192.168.206.53@tcp:101:bash.0 Request processed in 13452us (13713us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100607.096354:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:1.0:1786100607.105625:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100607.105740:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941793536 00000100:00100000:3.0:1786100607.105750:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941793536 00000100:00100000:3.0:1786100607.105806:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:3.0:1786100607.105815:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+18:11360:x1872861941793536:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:3.0:1786100607.106333:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+19:11360:x1872861941793536:12345-192.168.206.53@tcp:35:bash.0 Request processed in 518us (715us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1786100607.106351:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:3.0:1786100607.118437:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100607.118535:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100607.121351:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941793664 00000100:00100000:0.0:1786100607.121367:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941793664 00002000:00100000:0.0:1786100607.121436:0:6690:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a3c74863480 x1872861941793664/t0(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:138/0 lens 504/0 e 0 to 0 dl 1786100618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786100607.121463:0:6690:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c74863480 with x1872861941793664 ext(0->12) 00002000:00010000:0.0:1786100607.121469:0:6690:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3c74863480 00000100:00100000:0.0:1786100607.121510:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:0.0:1786100607.121519:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941793664:12345-192.168.206.53@tcp:4:bash.0 00000100:00100000:0.0:1786100607.122065:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2a93440-3d3b-4616-8388-e39125c10990+8:2351:x1872861941793664:12345-192.168.206.53@tcp:4:bash.0 Request processed in 544us (3527us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1786100607.122076:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00002000:00100000:0.0:1786100607.122402:0:6690:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a3c74863480 x1872861941793664/t4294967305(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:138/0 lens 504/448 e 0 to 0 dl 1786100618 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786100607.122413:0:6690:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c74863480 with x1872861941793664 ext(0->12) 00002000:00010000:0.0:1786100607.122417:0:6690:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3c74863480 00000100:00100000:2.0:1786100607.129774:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941793792 00000100:00100000:2.0:1786100607.129788:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941793792 00000100:00100000:2.0:1786100607.129850:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:2.0:1786100607.129861:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+8:2351:x1872861941793792:12345-192.168.206.53@tcp:16:kworker.0 00010000:00010000:1.0:1786100607.145921:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100607.257267:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100607.257345:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941794048 00000100:00100000:3.0:1786100607.257356:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941794048 00000100:00100000:3.0:1786100607.257422:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 144 00000100:00100000:3.0:1786100607.257431:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+19:11370:x1872861941794048:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100607.257456:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100607.257476:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac172e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30e7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100607.257583:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1786100607.257723:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac172e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e7 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.257738:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:3.0:1786100607.257741:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786100607.257746:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac172e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e7 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.257760:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99800, rc 0) 00000100:00100000:3.0:1786100607.257815:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+20:11370:x1872861941794048:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 384us (557us total) trans 4294967420 rc 301/301 00000100:00100000:3.0:1786100607.257822:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 144 00000100:00100000:2.0:1786100607.265704:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+8:2351:x1872861941793792:12345-192.168.206.53@tcp:16:kworker.0 Request processed in 135835us (147271us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100607.265717:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 49 00000001:00080000:2.0:1786100607.265766:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1786100607.265824:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100607.265933:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941794304 00000100:00100000:2.0:1786100607.265942:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941794304 00000100:00100000:2.0:1786100607.265979:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:2.0:1786100607.265987:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+20:11370:x1872861941794304:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:2.0:1786100607.266180:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+21:11370:x1872861941794304:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 193us (356us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1786100607.266188:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:2.0:1786100607.368211:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100607.369007:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941794432 00000100:00100000:3.0:1786100607.369027:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941794432 00000100:00100000:3.0:1786100607.369103:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 145 00000100:00100000:3.0:1786100607.369119:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+21:11376:x1872861941794432:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100607.369146:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100607.369169:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac173c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.369231:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1743 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.369245:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.369257:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100607.369309:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1786100607.369313:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786100607.369331:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.369357:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac173c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30ee expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.369374:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30ee expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.369382:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:3.0:1786100607.369385:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786100607.369388:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99a00, rc 0) 00000100:00100000:3.0:1786100607.369453:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+22:11376:x1872861941794432:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 341us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100607.369467:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 145 00000100:00100000:1.0:1786100607.373569:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100607.373644:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941794688 00000100:00100000:3.0:1786100607.373688:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941794688 00000100:00100000:3.0:1786100607.373743:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 146 00000100:00100000:3.0:1786100607.373752:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+22:11376:x1872861941794688:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100607.373772:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100607.373792:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac174a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30f5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.373897:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1751 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.373910:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.373922:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100607.373933:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1786100607.374233:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac174a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30f5 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.374253:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1751 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30f5 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.374261:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1d00) 00010000:00010000:3.0:1786100607.374263:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786100607.374267:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98e00, rc 0) 00000100:00100000:3.0:1786100607.374339:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+24:11376:x1872861941794688:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 587us (778us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1786100607.374347:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 146 00000100:00100000:2.0:1786100607.378060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100607.378171:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941794944 00000100:00100000:3.0:1786100607.378182:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941794944 00000100:00100000:3.0:1786100607.378241:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 147 00000100:00100000:3.0:1786100607.378250:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+24:11376:x1872861941794944:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100607.378272:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100607.378290:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac175f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c30fc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.378385:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1766 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.378399:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1766 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.378411:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1766 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100607.378422:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1786100607.378537:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac175f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30fc expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.378555:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1766 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30fc expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.378564:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1d00) 00010000:00010000:3.0:1786100607.378567:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786100607.378584:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99e00, rc 0) 00000100:00100000:3.0:1786100607.378643:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+26:11376:x1872861941794944:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 394us (593us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1786100607.379225:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 147 00000100:00100000:2.0:1786100607.385322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100607.385540:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941795072 00000100:00100000:1.0:1786100607.385551:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941795072 00000100:00100000:1.0:1786100607.385616:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:1.0:1786100607.385626:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+26:2352:x1872861941795072:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100607.385641:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100607.385690:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1751 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30f5 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.385709:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1d00) 00010000:00010000:1.0:1786100607.385713:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100607.385770:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+25:2352:x1872861941795072:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 146us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100607.385778:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:3.0:1786100607.409154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100607.411405:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941795200 00000100:00100000:0.0:1786100607.411498:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941795200 00000100:00100000:0.0:1786100607.411562:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:0.0:1786100607.411572:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2354:x1872861941795200:12345-192.168.206.53@tcp:1:lfs.0 00010000:00010000:0.0:1786100607.411982:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.412004:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac1727 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e0 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.412012:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100607.412017:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786100607.412022:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.412070:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac1727 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e0 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.412084:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac1727 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e0 expref: 6 pid: 6684 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100607.412098:0:6686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6686:1872861960675840:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100607.412183:0:6686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74900cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100607.417404:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100607.417437:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941795328 00000100:00100000:0.0:1786100607.417446:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941795328 00010000:00010000:0.0:1786100607.417483:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac1727 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e0 expref: 7 pid: 6684 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100607.417531:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:0.0:1786100607.417542:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+7:2351:x1872861941795328:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100607.417557:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786100607.417575:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1786100607.417578:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1786100606 00002000:00010000:0.0:1786100607.417581:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1786100606 00002000:00010000:0.0:1786100607.417583:0:5829:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1786100607.417594:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac1727 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e0 expref: 7 pid: 6684 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100607.417977:0:6686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6686:1872861960675840:192.168.206.53@tcp:104: 00010000:00010000:3.0:1786100607.417999:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.418228:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac1727 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e0 expref: 7 pid: 6684 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.418252:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbda8d5e/0x5564f2c20ac1727 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30e0 expref: 7 pid: 6684 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.418267:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786100607.418272:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786100607.418277:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.418286:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.418315:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100607.418365:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941795328:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 824us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100607.418374:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 63 00010000:00010000:3.0:1786100607.418829:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.418839:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.418865:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.418885:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.418893:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.418900:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbae00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100607.418903:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.418919:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.418932:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.418939:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da8bedfc/0x5564f2c20ac1774 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100607.418992:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941795200:12345-192.168.206.53@tcp:1:lfs.0 Request processed in 7421us (9845us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100607.418999:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:0.0:1786100607.425918:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100607.426553:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941795584 00000100:00100000:1.0:1786100607.426563:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941795584 00000100:00100000:1.0:1786100607.426617:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:1.0:1786100607.426627:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6af02050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+25:11376:x1872861941795584:12345-192.168.206.53@tcp:35:lfs.0 00000004:00010000:1.0:1786100607.426709:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1766 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30fc expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786100607.427848:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1786100607.427928:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1786100607.429159:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:1.0:1786100607.429239:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.429257:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1712 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d2 expref: 29 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.429266:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.429301:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d2 expref: 29 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.429316:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1712 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d2 expref: 29 pid: 9953 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100607.429330:0:5846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1872861960675968:192.168.206.53@tcp:104: 00000100:00100000:1.0:1786100607.429418:0:5846:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b42323780 going to sleep for 11 seconds 00000100:00100000:2.0:1786100607.432700:0:5846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1872861960675968:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100607.432730:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100607.433191:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100607.433372:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941795712 00000100:00100000:3.0:1786100607.433380:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941795712 00010000:00010000:3.0:1786100607.433413:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1712 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d2 expref: 30 pid: 9953 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100607.433458:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00100000:3.0:1786100607.433467:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+30:2352:x1872861941795712:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100607.433481:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100607.433487:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1712 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d2 expref: 30 pid: 9953 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.433499:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d2 expref: 30 pid: 9953 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.433536:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1712 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30d2 expref: 30 pid: 9953 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.433551:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1d00) 00010000:00010000:3.0:1786100607.433557:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.433566:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.433574:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.433594:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100607.433636:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+29:2352:x1872861941795712:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 170us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100607.433644:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 64 00010000:00010000:2.0:1786100607.434189:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100607.434197:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786100607.434300:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1786100607.434501:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1786100607.434602:0:5846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db25f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1872861960676096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786100607.434683:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100607.434706:0:5846:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddbae40 going to sleep for 11 seconds 00000100:00100000:0.0:1786100607.434812:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960676096 00000100:00100000:0.0:1786100607.434818:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960676096 00000100:00100000:0.0:1786100607.434866:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786100607.434887:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1872861960676096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786100607.434959:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1872861960676096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100607.434975:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786100607.435009:0:5846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db25f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1872861960676096:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1786100607.435569:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1786100607.435792:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1786100607.435848:0:5846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1872861960676224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786100607.436798:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100607.436866:0:5846:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74900c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786100607.445152:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960676224 00000100:00100000:2.0:1786100607.445176:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960676224 00000100:00100000:1.0:1786100607.445818:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786100607.445829:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1872861960676224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786100607.446143:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1872861960676224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 315us (9347us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1786100607.446152:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786100607.446200:0:5846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1872861960676224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1786100607.446263:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1786100607.446304:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.446314:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.446328:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.446334:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100607.446338:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.446346:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.446361:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1d00) 00010000:00010000:1.0:1786100607.446364:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1786100607.446369:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.446375:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac177b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786100607.446551:0:5846:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1786100607.446721:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1786100607.446731:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348689079006ns, next at 349689077338ns, rc = 0 00000001:00080000:1.0:1786100607.446737:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1786100607.446765:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1d00) 00010000:00010000:1.0:1786100607.446769:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786100607.446775:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1766 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30fc expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100607.446859:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6af02050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+32:11376:x1872861941795584:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 20233us (20948us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1786100607.446889:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 38 00000020:00080000:1.0:1786100607.446894:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1786100607.453106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100607.453534:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941795840 00000100:00100000:1.0:1786100607.453544:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941795840 00000100:00100000:1.0:1786100607.453603:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 148 00000100:00100000:1.0:1786100607.453614:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+32:11376:x1872861941795840:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100607.453635:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100607.453676:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1782 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3103 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.453733:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1782 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3103 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.453747:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1782 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3103 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.453765:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:1.0:1786100607.453768:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786100607.453772:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165fc00, rc 0) 00000100:00100000:1.0:1786100607.453828:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+33:11376:x1872861941795840:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 216us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100607.453835:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 148 00000001:00080000:0.0:1786100607.464867:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000001:00080000:0.0:1786100607.464894:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967421 is committed 00000001:00080000:0.0:1786100607.464902:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967423 is committed 00000100:00100000:0.0:1786100607.464987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100607.466128:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941796096 00000100:00100000:1.0:1786100607.466139:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941796096 00000100:00100000:1.0:1786100607.466191:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:1.0:1786100607.466201:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+25:11376:x1872861941796096:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1786100607.466431:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+26:11376:x1872861941796096:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 230us (1447us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1786100607.466439:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:2.0:1786100607.573231:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100607.576528:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941796352 00000100:00100000:1.0:1786100607.576545:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941796352 00000100:00100000:1.0:1786100607.576690:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 149 00000100:00100000:1.0:1786100607.576701:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+26:11386:x1872861941796352:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100607.576726:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100607.576747:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1789 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c310a expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100607.576996:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1786100607.577167:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1789 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c310a expref: 28 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.577183:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:1.0:1786100607.577185:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786100607.577190:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1789 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c310a expref: 28 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.577203:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f000, rc 0) 00000100:00100000:1.0:1786100607.577277:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+27:11386:x1872861941796352:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 579us (4057us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1786100607.577284:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 149 00000100:00100000:0.0:1786100607.585819:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100607.585905:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941796480 00000100:00100000:1.0:1786100607.585915:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941796480 00000100:00100000:1.0:1786100607.585973:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 150 00000100:00100000:1.0:1786100607.585993:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+27:11386:x1872861941796480:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:1.0:1786100607.586066:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1797 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586083:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1797 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586095:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1797 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586109:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac179e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586117:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac179e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586123:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac179e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586396:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac17a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586404:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac17a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586412:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac17a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786100607.586450:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac17a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586461:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1797 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586474:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1797 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586481:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1797 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586486:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100607.586490:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1797 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586497:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1797 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586510:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:1.0:1786100607.586513:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100607.586518:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1797 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586524:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1797 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586538:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac179e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586543:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac179e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586549:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac179e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586553:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100607.586562:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac179e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586568:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac179e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586577:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c461b1d00) 00010000:00010000:1.0:1786100607.586579:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100607.586581:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac179e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586587:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac179e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586601:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac17a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586607:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac17a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586613:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac17a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586619:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fa00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100607.586622:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac17a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586627:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac17a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586634:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:1.0:1786100607.586635:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100607.586644:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac17a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100607.586689:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac17a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100607.586759:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+27:11386:x1872861941796480:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 765us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100607.586767:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 150 00000100:00100000:0.0:1786100607.591131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100607.591212:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941796736 00000100:00100000:1.0:1786100607.591223:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941796736 00000100:00100000:1.0:1786100607.591287:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:1.0:1786100607.591297:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+27:11386:x1872861941796736:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1786100607.591764:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+28:11386:x1872861941796736:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 466us (639us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1786100607.591772:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:0.0:1786100607.627129:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100607.627173:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100607.627205:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100607.627299:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941796864 00000100:00100000:1.0:1786100607.627310:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941796864 00000100:00100000:1.0:1786100607.627363:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 294 00000100:00100000:1.0:1786100607.627373:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+13:2353:x1872861941796864:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100607.627436:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d69173c-d092-48de-a520-1459f9171aec+13:2353:x1872861941796864:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 65us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100607.627443:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 294 00000100:00100000:3.0:1786100607.627577:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941797120 00000100:00100000:3.0:1786100607.627582:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941797120 00000100:00100000:3.0:1786100607.627631:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 150 00000100:00100000:3.0:1786100607.627639:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941797120:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100607.627700:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941797120:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 62us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100607.627706:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 150 00000100:00100000:2.0:1786100607.627866:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941796992 00000100:00100000:2.0:1786100607.627883:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941796992 00000100:00100000:2.0:1786100607.627932:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 88 00000100:00100000:2.0:1786100607.627940:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941796992:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100607.627969:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941796992:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 30us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100607.627976:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 88 00000100:00080000:3.0:1786100607.628543:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786100607.641118:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100607.641204:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941797376 00000100:00100000:3.0:1786100607.641226:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941797376 00000100:00100000:3.0:1786100607.641291:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 151 00000100:00100000:3.0:1786100607.641302:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+28:11389:x1872861941797376:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100607.641328:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100607.641349:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3111 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.641422:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.641436:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.641447:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.641463:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.641470:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.641476:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.641837:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac17c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.641848:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac17c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.641855:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac17c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100607.641888:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1786100607.641980:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.641989:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.641996:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642002:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100607.642006:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642013:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642026:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:3.0:1786100607.642029:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100607.642033:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642039:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642051:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642057:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642073:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642078:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100607.642081:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642087:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642095:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c454ab900) 00010000:00010000:3.0:1786100607.642097:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100607.642099:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642105:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642146:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3111 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642159:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac17c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3111 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.642166:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:3.0:1786100607.642168:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786100607.642170:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99200, rc 0) 00000100:00100000:3.0:1786100607.642222:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+30:11389:x1872861941797376:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 921us (1113us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1786100607.642237:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 151 00000100:00100000:0.0:1786100607.651198:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100607.651339:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941797504 00000100:00100000:3.0:1786100607.651350:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941797504 00000100:00100000:3.0:1786100607.651416:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 152 00000100:00100000:3.0:1786100607.651427:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+30:11389:x1872861941797504:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:3.0:1786100607.651507:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.651646:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.651693:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.651718:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.651725:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.651731:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.651738:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100607.651742:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.651750:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.651762:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:3.0:1786100607.651771:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786100607.651776:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.651783:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100607.651858:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+30:11389:x1872861941797504:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 432us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100607.651866:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 152 00000100:00100000:0.0:1786100607.658454:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100607.658606:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941797760 00000100:00100000:1.0:1786100607.658616:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941797760 00000100:00100000:1.0:1786100607.658703:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:1.0:1786100607.658714:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+30:11389:x1872861941797760:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1786100607.658982:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+31:11389:x1872861941797760:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 268us (535us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1786100607.658991:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:2.0:1786100607.978617:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100607.978786:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941798016 00000100:00100000:3.0:1786100607.978797:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941798016 00000100:00100000:3.0:1786100607.978862:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 153 00000100:00100000:3.0:1786100607.978884:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+31:11420:x1872861941798016:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:3.0:1786100607.978909:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100607.978929:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3118 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.979038:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.979059:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.979072:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100607.979082:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1786100607.979492:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3118 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.979529:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3118 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100607.979538:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:3.0:1786100607.979542:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786100607.979545:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99400, rc 0) 00000100:00100000:3.0:1786100607.979609:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+33:11420:x1872861941798016:12345-192.168.206.53@tcp:101:cat.0 Request processed in 738us (999us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1786100607.979618:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 153 00000100:00100000:2.0:1786100607.993000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100607.993342:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100607.993430:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941798400 00000100:00100000:0.0:1786100607.993441:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941798400 00000100:00100000:0.0:1786100607.993514:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:0.0:1786100607.993632:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+33:2351:x1872861941798400:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100607.993804:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100607.993834:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac17dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3118 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100607.993883:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:0.0:1786100607.993888:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100607.993948:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+32:2351:x1872861941798400:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 425us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100607.993957:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:1.0:1786100607.997571:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941798272 00000100:00100000:1.0:1786100607.997585:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941798272 00000100:00100000:1.0:1786100607.997678:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:1.0:1786100607.997689:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+32:11420:x1872861941798272:12345-192.168.206.53@tcp:35:cat.0 00000100:00100000:1.0:1786100607.997952:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+33:11420:x1872861941798272:12345-192.168.206.53@tcp:35:cat.0 Request processed in 265us (4960us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1786100607.997960:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:2.0:1786100608.051639:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100608.051802:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941798656 00000100:00100000:3.0:1786100608.051813:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941798656 00000100:00100000:3.0:1786100608.051898:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 154 00000100:00100000:3.0:1786100608.051911:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+33:11426:x1872861941798656:12345-192.168.206.53@tcp:101:dd.0 00010000:00010000:3.0:1786100608.051938:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100608.051942:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786100608.051968:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac1743 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30ee expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.051987:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:3.0:1786100608.051993:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786100608.052006:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c311f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.052106:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786100608.052228:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786100608.053010:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac17c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3111 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.053020:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.053057:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac17c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3111 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.053072:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac17c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3111 expref: 33 pid: 5845 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100608.053090:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74861c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1872861960676352:192.168.206.53@tcp:104: 00000100:00100000:3.0:1786100608.053328:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c45bbbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1786100608.059198:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74861c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1872861960676352:192.168.206.53@tcp:104: 00010000:00010000:3.0:1786100608.059227:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100608.059413:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100608.059853:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941798784 00000100:00100000:3.0:1786100608.059860:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941798784 00010000:00010000:3.0:1786100608.059909:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac17c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3111 expref: 34 pid: 5845 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100608.059949:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:3.0:1786100608.059959:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+34:2351:x1872861941798784:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100608.059974:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100608.059994:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac17c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3111 expref: 34 pid: 5845 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.060006:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac17c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3111 expref: 34 pid: 5845 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.060029:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac17c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3111 expref: 34 pid: 5845 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.060043:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:3.0:1786100608.060058:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.060068:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.060076:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.060109:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786100608.060264:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.060273:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100608.060291:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1786100608.060460:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac17eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c311f expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.060477:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c311f expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.060485:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:1.0:1786100608.060489:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786100608.060492:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99000, rc 0) 00000100:00100000:1.0:1786100608.060562:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+34:11426:x1872861941798656:12345-192.168.206.53@tcp:101:dd.0 Request processed in 8653us (8931us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1786100608.060578:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 154 00000100:00100000:3.0:1786100608.061645:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+33:2351:x1872861941798784:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 1680us (2226us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100608.061856:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:2.0:1786100608.069010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100608.069338:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941799040 00000100:00100000:3.0:1786100608.069349:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941799040 00000100:00100000:3.0:1786100608.069405:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 155 00000100:00100000:3.0:1786100608.069416:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+33:11426:x1872861941799040:12345-192.168.206.53@tcp:36:dd.0 00010000:00010000:3.0:1786100608.069842:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1800 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.069893:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.069905:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786100608.069959:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:3.0:1786100608.069985:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002eb19510 reply state 0000000002612d1c transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100608.069994:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786100608.070292:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+36:11426:x1872861941799040:12345-192.168.206.53@tcp:36:dd.0 Request processed in 877us (1289us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1786100608.070302:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 155 00000020:00080000:3.0:1786100608.070307:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786100608.074362:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.074377:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1800 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.074384:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1800 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.074390:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100608.074395:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1800 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.074402:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1800 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.074449:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:3.0:1786100608.074452:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100608.074457:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1800 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.074463:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1800 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.165999:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100608.362618:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100608.363054:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941799168 00000100:00100000:1.0:1786100608.363065:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941799168 00000100:00100000:1.0:1786100608.363133:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 156 00000100:00100000:1.0:1786100608.363144:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+35:11440:x1872861941799168:12345-192.168.206.53@tcp:101:stat.0 00010000:00010000:1.0:1786100608.363167:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100608.363188:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1807 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3126 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.363255:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac180e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.363269:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac180e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.363280:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac180e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.363294:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1815 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.363301:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.363309:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.363733:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac181c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.363756:0:9953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c311f expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.363764:0:9953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac181c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.363796:0:9953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c311f expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.363808:0:9953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c311f expref: 36 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100608.363821:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960676480:192.168.206.53@tcp:104: 00000100:00100000:1.0:1786100608.363996:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b423236c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100608.368079:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960676480:192.168.206.53@tcp:104: 00010000:00010000:3.0:1786100608.368108:0:9953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac181c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100608.368612:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100608.368960:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941799424 00000100:00100000:1.0:1786100608.368968:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941799424 00000100:00100000:1.0:1786100608.369080:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:1.0:1786100608.369091:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+37:5590:x1872861941799424:12345-192.168.206.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1786100608.369591:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+38:5590:x1872861941799424:12345-192.168.206.53@tcp:35:ldlm_bl.0 Request processed in 501us (980us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1786100608.369600:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:2.0:1786100608.374389:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100608.374573:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941799552 00000100:00100000:3.0:1786100608.374584:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941799552 00010000:00010000:3.0:1786100608.374621:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c311f expref: 38 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100608.374691:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:3.0:1786100608.374701:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+38:2351:x1872861941799552:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100608.374716:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100608.374723:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c311f expref: 38 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.374737:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c311f expref: 38 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.374759:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac17f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c311f expref: 38 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.374792:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:3.0:1786100608.374797:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac181c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.374808:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac181c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.374816:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac181c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.374843:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100608.374906:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+37:2351:x1872861941799552:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 206us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100608.374914:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 66 00010000:00010000:3.0:1786100608.374939:0:9953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac181c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.374957:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac181c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100608.374998:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1786100608.375003:0:9953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786100608.375022:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac181c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375034:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac181c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375043:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac180e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375510:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac180e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375517:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac180e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375523:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100608.375527:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac180e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375533:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac180e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375543:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:3.0:1786100608.375546:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100608.375550:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac180e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375556:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac180e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375570:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375576:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1815 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375582:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375586:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100608.375594:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375601:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1815 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375609:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c461b1d00) 00010000:00010000:3.0:1786100608.375611:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100608.375614:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1815 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375620:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1815 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375686:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1807 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3126 expref: 37 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375699:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac181c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3126 expref: 36 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.375706:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:3.0:1786100608.375708:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786100608.375711:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165e000, rc 0) 00000100:00100000:3.0:1786100608.375738:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+36:11440:x1872861941799168:12345-192.168.206.53@tcp:101:stat.0 Request processed in 12597us (13129us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100608.375744:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 156 00000100:00100000:2.0:1786100608.465622:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100608.465882:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941799808 00000100:00100000:3.0:1786100608.465893:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941799808 00000100:00100000:3.0:1786100608.466003:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 157 00000100:00100000:3.0:1786100608.466015:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+36:11446:x1872861941799808:12345-192.168.206.53@tcp:36:truncate.0 00010000:00010000:3.0:1786100608.466099:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100608.466128:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac181c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3126 expref: 36 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.466147:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:3.0:1786100608.466151:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786100608.466339:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1823 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.466353:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.466363:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786100608.466422:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:3.0:1786100608.466446:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073472ee1 reply state 000000003356eca3 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100608.466455:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786100608.466550:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+38:11446:x1872861941799808:12345-192.168.206.53@tcp:36:truncate.0 Request processed in 536us (935us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1786100608.466558:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 157 00000020:00080000:3.0:1786100608.466563:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786100608.473214:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.473231:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1823 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.473239:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.473428:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100608.473434:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.473443:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1823 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.473461:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:3.0:1786100608.473464:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100608.473469:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1823 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.473475:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1823 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100608.643475:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100608.643545:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941799936 00000100:00100000:3.0:1786100608.643556:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941799936 00000100:00100000:3.0:1786100608.643620:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 158 00000100:00100000:3.0:1786100608.643630:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+37:11460:x1872861941799936:12345-192.168.206.53@tcp:101:stat.0 00010000:00010000:3.0:1786100608.643694:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100608.643716:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac182a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c312d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.643780:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1831 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.643793:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.643805:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.646552:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1838 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.646575:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.646587:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647291:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac183f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647304:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac183f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647312:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac183f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100608.647359:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1786100608.647364:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100608.647389:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac183f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647646:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac183f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647841:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647848:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1831 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647855:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1831 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647862:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100608.647875:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1831 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647883:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1831 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647904:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:2.0:1786100608.647907:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100608.647912:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1831 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647919:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1831 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647932:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647938:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1838 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647944:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647949:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51fa00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100608.647952:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647958:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1838 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647964:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c454ab900) 00010000:00010000:2.0:1786100608.647967:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100608.647970:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1838 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.647975:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1838 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.648038:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac182a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c312d expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.648054:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac183f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c312d expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.648061:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:2.0:1786100608.648064:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100608.648067:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51ea00, rc 0) 00000100:00100000:2.0:1786100608.648206:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+38:11460:x1872861941799936:12345-192.168.206.53@tcp:101:stat.0 Request processed in 4576us (4738us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100608.648214:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 158 00000100:00100000:2.0:1786100608.790080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100608.790183:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941800192 00000100:00100000:1.0:1786100608.790194:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941800192 00000100:00100000:1.0:1786100608.790255:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 159 00000100:00100000:1.0:1786100608.790279:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+38:11470:x1872861941800192:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100608.790301:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100608.790335:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3134 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100608.790746:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1786100608.790925:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1846 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3134 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.790940:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:1.0:1786100608.790943:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786100608.790947:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3134 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.790960:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f800, rc 0) 00000100:00100000:1.0:1786100608.791020:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+39:11470:x1872861941800192:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 755us (947us total) trans 4294967446 rc 301/301 00000100:00100000:1.0:1786100608.791027:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 159 00000100:00100000:1.0:1786100608.794034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100608.794168:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941800448 00000100:00100000:0.0:1786100608.794177:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941800448 00000100:00100000:0.0:1786100608.794232:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:0.0:1786100608.794242:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6af00450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+39:11470:x1872861941800448:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1786100608.800037:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6af00450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+40:11470:x1872861941800448:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 5787us (6002us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1786100608.800274:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:2.0:1786100608.866971:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100608.867095:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941800704 00000100:00100000:0.0:1786100608.867107:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941800704 00000100:00100000:0.0:1786100608.867179:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 160 00000100:00100000:0.0:1786100608.867191:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+40:11476:x1872861941800704:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1786100608.867221:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100608.867247:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1854 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c313b expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100608.867385:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100608.867402:0:9953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac183f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c312d expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100608.867412:0:9953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100608.867479:0:9953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac183f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c312d expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100608.867496:0:9953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac183f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c312d expref: 41 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100608.867513:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7bfcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960676608:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100608.868017:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74940e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786100608.872021:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7bfcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960676608:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100608.872060:0:9953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100608.872790:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100608.872884:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941800832 00000100:00100000:3.0:1786100608.872894:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941800832 00010000:00010000:3.0:1786100608.872946:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac183f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c312d expref: 42 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100608.873041:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 67 00000100:00100000:3.0:1786100608.873054:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+42:2351:x1872861941800832:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100608.873072:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100608.873080:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac183f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c312d expref: 42 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.873094:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac183f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c312d expref: 42 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.873124:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac183f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c312d expref: 42 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.873145:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:3.0:1786100608.873150:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.873161:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.873169:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.873268:0:9953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.873272:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786100608.873275:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100608.873299:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000100:00100000:3.0:1786100608.873443:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+42:2351:x1872861941800832:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 391us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100608.873452:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 67 00010000:00010000:1.0:1786100608.873501:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1854 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c313b expref: 42 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.873534:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c313b expref: 41 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.873541:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:1.0:1786100608.873544:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786100608.873547:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbbc00, rc 0) 00000100:00100000:1.0:1786100608.873576:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+41:11476:x1872861941800704:12345-192.168.206.53@tcp:101:bash.0 Request processed in 6388us (6618us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1786100608.873583:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 160 00000100:00100000:2.0:1786100608.879099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100608.879462:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941801088 00000100:00100000:1.0:1786100608.879475:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941801088 00000100:00100000:1.0:1786100608.879547:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 161 00000100:00100000:1.0:1786100608.879559:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+41:11476:x1872861941801088:12345-192.168.206.53@tcp:36:bash.0 00010000:00010000:1.0:1786100608.880370:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1869 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.880395:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.880409:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786100608.880472:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:1.0:1786100608.880500:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001cf2fd33 reply state 000000005c236ab9 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100608.880510:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786100608.881082:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+44:11476:x1872861941801088:12345-192.168.206.53@tcp:36:bash.0 Request processed in 1520us (1991us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1786100608.881093:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 161 00000020:00080000:1.0:1786100608.881099:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786100608.886877:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.886899:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1869 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.886908:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.886915:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100608.886921:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.886930:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1869 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.886950:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:3.0:1786100608.886953:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100608.886959:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1869 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.886965:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1869 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100608.888877:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100608.889253:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941801216 00000100:00100000:1.0:1786100608.889265:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941801216 00000100:00100000:1.0:1786100608.889339:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 162 00000100:00100000:1.0:1786100608.889351:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+43:11476:x1872861941801216:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:1.0:1786100608.889381:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100608.889406:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1870 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3142 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.889544:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.889560:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c313b expref: 44 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.889569:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1877 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.889608:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c313b expref: 44 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.889622:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c313b expref: 44 pid: 9953 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100608.889677:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1872861960676736:192.168.206.53@tcp:104: 00000100:00100000:1.0:1786100608.889774:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74900480 going to sleep for 11 seconds 00000100:00100000:2.0:1786100608.892723:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100608.893244:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941801344 00000100:00100000:3.0:1786100608.893258:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941801344 00010000:00010000:3.0:1786100608.893313:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c313b expref: 45 pid: 9953 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100608.893399:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 68 00000100:00100000:3.0:1786100608.893410:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+45:2352:x1872861941801344:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100608.893440:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100608.893449:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c313b expref: 45 pid: 9953 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.893465:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c313b expref: 45 pid: 9953 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.893492:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:3.0:1786100608.893498:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.893511:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.893518:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1877 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100608.893545:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100608.893640:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+45:2352:x1872861941801344:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 222us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100608.893679:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 68 00010000:00010000:1.0:1786100608.895187:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac185b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c313b expref: 44 pid: 9953 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100608.895214:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1872861960676736:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100608.895242:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.895253:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.895260:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100608.895324:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1786100608.895329:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100608.895441:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.895483:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1870 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3142 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.895502:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3142 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.895511:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:1.0:1786100608.895514:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786100608.895517:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165fa00, rc 0) 00000100:00100000:1.0:1786100608.895595:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+43:11476:x1872861941801216:12345-192.168.206.53@tcp:101:bash.0 Request processed in 6245us (6739us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100608.895604:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 162 00000100:00100000:2.0:1786100608.902790:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100608.903344:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941801600 00000100:00100000:1.0:1786100608.903358:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941801600 00000100:00100000:1.0:1786100608.903440:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:1.0:1786100608.903452:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+43:11476:x1872861941801600:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:1.0:1786100608.903792:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+44:11476:x1872861941801600:12345-192.168.206.53@tcp:35:bash.0 Request processed in 341us (1016us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1786100608.903799:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:3.0:1786100608.951773:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100608.953104:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941801856 00000100:00100000:2.0:1786100608.953122:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941801856 00000100:00100000:2.0:1786100608.953274:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 163 00000100:00100000:2.0:1786100608.953286:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+44:11486:x1872861941801856:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100608.953318:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100608.953355:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac187e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3149 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100608.953737:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1786100608.954149:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac187e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3149 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.954167:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:2.0:1786100608.954171:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786100608.954177:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac187e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3149 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100608.954193:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f200, rc 0) 00000100:00100000:2.0:1786100608.954294:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+45:11486:x1872861941801856:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1009us (2534us total) trans 4294967452 rc 301/301 00000100:00100000:2.0:1786100608.954303:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 163 00000100:00100000:0.0:1786100608.957577:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100608.957732:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941801984 00000100:00100000:1.0:1786100608.957745:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941801984 00000100:00100000:1.0:1786100608.957843:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 164 00000100:00100000:1.0:1786100608.957855:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+45:11486:x1872861941801984:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:1.0:1786100608.957980:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac188c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958000:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac188c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958014:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac188c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958032:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958040:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958047:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958613:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac189a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958644:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac189a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958690:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac189a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786100608.958746:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac189a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958761:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac188c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958768:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac188c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958775:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac188c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958783:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100608.958787:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac188c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958795:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac188c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958809:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:1.0:1786100608.958813:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100608.958819:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac188c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958826:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac188c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958854:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958860:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1893 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958933:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958939:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100608.958941:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958947:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1893 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958955:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c461b1400) 00010000:00010000:1.0:1786100608.958958:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100608.958961:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1893 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958966:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1893 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958982:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac189a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958988:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac189a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.958995:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac189a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.959007:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100608.959011:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac189a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.959018:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac189a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.959026:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:1.0:1786100608.959029:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100608.959032:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac189a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100608.959039:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac189a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100608.959231:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+45:11486:x1872861941801984:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 1373us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100608.959243:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 164 00000100:00100000:3.0:1786100608.961882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100608.961959:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941802240 00000100:00100000:1.0:1786100608.961972:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941802240 00000100:00100000:1.0:1786100608.962072:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:1.0:1786100608.962084:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+45:11486:x1872861941802240:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1786100608.963201:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+46:11486:x1872861941802240:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 1112us (1336us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1786100608.963213:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:3.0:1786100609.002087:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100609.003459:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941802496 00000100:00100000:1.0:1786100609.003493:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941802496 00000100:00100000:1.0:1786100609.003587:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 165 00000100:00100000:1.0:1786100609.003619:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+46:11489:x1872861941802496:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100609.003699:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100609.003726:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac18a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3150 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.003823:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac18a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.003839:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac18a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.003853:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac18a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.003882:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac18af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.003890:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac18af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.003898:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac18af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004280:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac18b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004290:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac18b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004297:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac18b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100609.004318:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1786100609.004446:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac18a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004455:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac18a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004463:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac18a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004469:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100609.004473:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac18a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004481:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac18a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004495:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:1.0:1786100609.004498:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100609.004504:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac18a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004511:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac18a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004526:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac18af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004533:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac18af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004539:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac18af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004551:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100609.004555:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac18af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004560:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac18af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004568:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c461b1400) 00010000:00010000:1.0:1786100609.004570:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100609.004573:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac18af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004579:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac18af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004629:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac18a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3150 expref: 49 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004645:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac18b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3150 expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.004727:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:1.0:1786100609.004729:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786100609.004732:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165e000, rc 0) 00000100:00100000:1.0:1786100609.004816:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+48:11489:x1872861941802496:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1199us (2743us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1786100609.004825:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 165 00000100:00100000:0.0:1786100609.011388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100609.011539:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941802624 00000100:00100000:2.0:1786100609.011551:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941802624 00000100:00100000:2.0:1786100609.011614:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 166 00000100:00100000:2.0:1786100609.011626:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+48:11489:x1872861941802624:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:2.0:1786100609.011762:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.011782:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.011794:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.011828:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.011851:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.011858:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.011878:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100609.011883:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.011892:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.011905:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:2.0:1786100609.011908:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786100609.011913:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.011920:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100609.012346:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+48:11489:x1872861941802624:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 718us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100609.012355:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 166 00000100:00100000:3.0:1786100609.015090:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100609.015279:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941802752 00000100:00100000:0.0:1786100609.015292:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941802752 00000100:00100000:0.0:1786100609.015369:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:0.0:1786100609.015382:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74861180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+48:2352:x1872861941802752:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100609.015402:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100609.015444:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac18b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3150 expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.015471:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:0.0:1786100609.015477:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100609.015551:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74861180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+47:2352:x1872861941802752:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 172us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100609.015569:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:3.0:1786100609.018529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100609.018631:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941803008 00000100:00100000:2.0:1786100609.018687:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941803008 00000100:00100000:2.0:1786100609.018758:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:2.0:1786100609.018770:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+47:11489:x1872861941803008:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:2.0:1786100609.019101:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+48:11489:x1872861941803008:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 332us (585us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1786100609.019135:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:1.0:1786100609.158362:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100609.165608:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941803264 00000100:00100000:2.0:1786100609.165966:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941803264 00000100:00100000:2.0:1786100609.166148:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 167 00000100:00100000:2.0:1786100609.166162:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+48:11507:x1872861941803264:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:2.0:1786100609.166194:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100609.166217:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3157 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.166346:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac18d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.166363:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac18d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.166376:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac18d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100609.166388:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1786100609.166555:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3157 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.166577:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac18d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3157 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.166587:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:2.0:1786100609.166590:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1786100609.166594:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51e000, rc 0) 00000100:00100000:2.0:1786100609.166750:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+50:11507:x1872861941803264:12345-192.168.206.53@tcp:101:cat.0 Request processed in 591us (8403us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1786100609.166758:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 167 00010000:00010000:2.0:1786100609.190700:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100609.241229:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100609.242011:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941803392 00000100:00100000:2.0:1786100609.242023:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941803392 00000100:00100000:2.0:1786100609.242890:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 168 00000100:00100000:2.0:1786100609.242909:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+50:11509:x1872861941803392:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100609.242944:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100609.242977:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c315e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.243057:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac18e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.243274:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac18e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.243287:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac18e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100609.243528:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1786100609.243532:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100609.243616:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac18e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.243676:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f200/0x5564f2c20ac18e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c315e expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.243697:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac18e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c315e expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.244190:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:2.0:1786100609.244194:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786100609.244198:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f000, rc 0) 00000100:00100000:2.0:1786100609.244340:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+51:11509:x1872861941803392:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1437us (3124us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100609.244349:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 168 00000100:00100000:1.0:1786100609.258645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100609.258881:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941803776 00000100:00100000:2.0:1786100609.258894:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941803776 00000100:00100000:2.0:1786100609.258967:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:2.0:1786100609.258980:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+51:11509:x1872861941803776:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1786100609.260362:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+52:11509:x1872861941803776:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 1374us (1720us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1786100609.260376:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:1.0:1786100609.268456:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100609.268951:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941803904 00000100:00100000:3.0:1786100609.268964:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941803904 00000100:00100000:3.0:1786100609.269052:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:3.0:1786100609.271048:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+52:11509:x1872861941803904:12345-192.168.206.53@tcp:103:lfs.0 00010000:00010000:3.0:1786100609.271299:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1786100609.271337:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1877 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3142 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.271366:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac18d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3157 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.271451:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1782 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3103 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.271463:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c461b1000) 00010000:00010000:3.0:1786100609.271475:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100609.274433:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+49:11509:x1872861941803904:12345-192.168.206.53@tcp:103:lfs.0 Request processed in 5352us (6044us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100609.274451:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:2.0:1786100609.279150:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100609.279330:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941804032 00000100:00100000:3.0:1786100609.279342:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941804032 00000100:00100000:3.0:1786100609.279423:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 169 00000100:00100000:3.0:1786100609.279555:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+49:11509:x1872861941804032:12345-192.168.206.53@tcp:58:lfs.0 00010000:00010000:3.0:1786100609.279767:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac18ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.279789:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac18ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.279803:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac18ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786100609.280917:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1786100609.282273:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+49:11509:x1872861941804032:12345-192.168.206.53@tcp:58:lfs.0 Request processed in 1504us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100609.288052:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 169 00000100:00100000:1.0:1786100609.326061:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100609.326262:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941804160 00000100:00100000:0.0:1786100609.326274:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941804160 00000100:00100000:0.0:1786100609.326348:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 170 00000100:00100000:0.0:1786100609.326362:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+49:11511:x1872861941804160:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1786100609.326390:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100609.326418:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac18f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3165 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.326504:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac18fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.326520:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac18fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.326533:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac18fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.326550:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1903 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.326557:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.326563:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.327411:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac190a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.327624:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac190a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.327637:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac190a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100609.327949:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1786100609.327955:0:9953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100609.327981:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac190a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.327996:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac190a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.328006:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac18fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.328013:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac18fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.328021:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac18fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.328028:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100609.328033:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac18fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.328055:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac18fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.328069:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:1.0:1786100609.328073:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100609.328078:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac18fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.328085:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac18fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.328102:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.328109:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1903 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.328115:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.328120:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100609.328123:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.328129:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1903 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.328136:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c433dfe00) 00010000:00010000:1.0:1786100609.328139:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100609.328142:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1903 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.329263:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1903 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.329347:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac18f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3165 expref: 51 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.329363:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac190a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3165 expref: 50 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.329383:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c454ab500) 00010000:00010000:1.0:1786100609.329386:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100609.329389:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165e000, rc 0) 00000100:00100000:1.0:1786100609.329507:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+50:11511:x1872861941804160:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 3146us (3459us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100609.329518:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 170 00000040:00080000:1.0:1786100609.508964:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786100609.508978:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786100609.510712:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1786100609.510728:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786100609.510931:0:11696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1872861960676864:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786100609.511396:0:11696:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74900cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100609.520744:0:11696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1872861960676864:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786100609.520782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100609.521341:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941804288 00000100:00100000:0.0:1786100609.521353:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941804288 00000100:00100000:0.0:1786100609.521431:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 171 00000100:00100000:0.0:1786100609.521444:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+50:11522:x1872861941804288:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786100609.521484:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786100609.521767:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+50:11522:x1872861941804288:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 323us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100609.521776:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 171 00000100:00100000:0.0:1786100609.532232:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100609.532319:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941804416 00000100:00100000:1.0:1786100609.532332:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941804416 00000100:00100000:1.0:1786100609.532410:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 172 00000100:00100000:1.0:1786100609.532422:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+50:11522:x1872861941804416:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1786100609.532527:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1911 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.532571:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1911 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.532586:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1911 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.532747:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1918 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.532757:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1918 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.532765:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1918 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.532800:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac191f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.532809:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac191f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.532816:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac191f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100609.532881:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1786100609.532887:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100609.532905:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac191f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533276:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1911 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533361:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1911 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533368:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1911 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533376:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100609.533381:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1911 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533389:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1911 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533403:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df900) 00010000:00010000:1.0:1786100609.533406:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100609.533412:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1911 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533418:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1911 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533430:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1918 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533436:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1918 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533442:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1918 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533446:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100609.533748:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1918 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533756:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1918 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533764:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9a3c461b1400) 00010000:00010000:1.0:1786100609.533767:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100609.533771:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1918 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533777:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1918 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533796:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac191f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533802:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac191f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533808:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac191f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533813:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100609.533816:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac191f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533821:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac191f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533828:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c454ab500) 00010000:00010000:1.0:1786100609.533830:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100609.533838:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac191f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.533843:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac191f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100609.534131:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+50:11522:x1872861941804416:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 Request processed in 1705us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100609.534141:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 172 00000100:00100000:1.0:1786100609.537880:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100609.538052:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941804672 00000100:00100000:3.0:1786100609.538064:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941804672 00000100:00100000:3.0:1786100609.538158:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 173 00000100:00100000:3.0:1786100609.538170:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+50:11522:x1872861941804672:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786100609.538195:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100609.538217:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1926 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c316c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.538375:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac192d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.538392:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac192d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.538405:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac192d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100609.538425:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1786100609.538807:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac192d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.538822:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac192d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.538829:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac192d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.538836:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100609.538840:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac192d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.538847:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac192d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.538870:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c454ab500) 00010000:00010000:3.0:1786100609.538873:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786100609.538877:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac192d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.538883:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac192d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.538989:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1926 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c316c expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.539000:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df900) 00010000:00010000:3.0:1786100609.539002:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786100609.539006:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac1926 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c316c expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.539016:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99c00, rc 0) 00000100:00100000:3.0:1786100609.539092:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+51:11522:x1872861941804672:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 925us (1235us total) trans 4294967458 rc 301/301 00000100:00100000:3.0:1786100609.539100:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 173 00000100:00100000:3.0:1786100609.542219:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100609.542266:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941804800 00000100:00100000:3.0:1786100609.542277:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941804800 00000100:00100000:3.0:1786100609.542405:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 174 00000100:00100000:3.0:1786100609.542713:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+51:11522:x1872861941804800:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786100609.542761:0:9953:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786100609.543006:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+51:11522:x1872861941804800:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 591us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100609.543015:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 174 00000100:00100000:3.0:1786100609.546207:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100609.546261:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941805056 00000100:00100000:3.0:1786100609.546272:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941805056 00000100:00100000:3.0:1786100609.547393:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 175 00000100:00100000:3.0:1786100609.547410:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+51:11522:x1872861941805056:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786100609.547447:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100609.547451:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786100609.547503:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac18e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c315e expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.547523:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:3.0:1786100609.547528:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786100609.547553:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac193b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3173 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786100609.550260:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1786100609.551260:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1942 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.551283:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.551730:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.551827:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac193b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3173 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.551846:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3173 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.551856:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a3c454aba00) 00010000:00010000:3.0:1786100609.551858:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786100609.552001:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99200, rc 0) 00000100:00100000:3.0:1786100609.552144:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+52:11522:x1872861941805056:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 4737us (5949us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1786100609.552154:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 175 00000100:00100000:3.0:1786100609.564365:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100609.564447:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941805312 00000100:00100000:2.0:1786100609.564460:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941805312 00000100:00100000:2.0:1786100609.564533:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 176 00000100:00100000:2.0:1786100609.564545:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+52:11522:x1872861941805312:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786100609.564625:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100609.564691:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac1942 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3173 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.564712:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a3c454aba00) 00010000:00010000:2.0:1786100609.564724:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100609.564750:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1950 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.564780:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1950 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.564790:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1950 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.564806:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1957 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd77335fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.564812:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77335fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.564818:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77335fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565304:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1950 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565314:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1950 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565320:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1950 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565326:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51fc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100609.565330:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1950 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565337:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1950 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565346:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:2.0:1786100609.565353:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100609.565358:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1950 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565364:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1950 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565373:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77335fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565378:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1957 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77335fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565384:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1957 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77335fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565388:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100609.565391:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1957 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77335fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565396:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1957 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77335fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565402:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd77335fd (ffff9a3c58043700) 00010000:00010000:2.0:1786100609.565404:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100609.565406:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1957 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd77335fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.565411:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1957 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd77335fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100609.565545:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+51:11522:x1872861941805312:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 999us (1192us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786100609.565563:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 176 00000100:00100000:3.0:1786100609.574752:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100609.574818:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941805440 00000100:00100000:0.0:1786100609.574837:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941805440 00000100:00100000:0.0:1786100609.574917:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 177 00000100:00100000:0.0:1786100609.574930:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+51:11522:x1872861941805440:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786100609.574957:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100609.574986:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac195e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c317a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.575032:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1965 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.575048:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.575061:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.575178:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac195e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c317a expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.575204:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c317a expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.575213:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a3c433df400) 00010000:00010000:0.0:1786100609.575217:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786100609.575220:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbbe00, rc 0) 00000100:00100000:0.0:1786100609.575295:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+52:11522:x1872861941805440:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 368us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100609.575302:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 177 00000100:00100000:3.0:1786100609.583332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100609.583786:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941805696 00000100:00100000:1.0:1786100609.583800:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941805696 00000100:00100000:1.0:1786100609.583957:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 178 00000100:00100000:1.0:1786100609.583970:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+52:11522:x1872861941805696:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786100609.584072:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac196c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.584091:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac196c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.584104:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac196c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786100609.584519:0:9953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1786100609.584532:0:9953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350826880659ns, next at 351826877673ns, rc = 0 00000004:00010000:1.0:1786100609.584634:0:9953:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009cfac0e reply state 00000000481b137c transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac196c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100609.584645:0:9953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786100609.584793:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+54:11522:x1872861941805696:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 824us (1473us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1786100609.584813:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 178 00000100:00100000:1.0:1786100609.595609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:3.0:1786100609.596081:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac196c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.596122:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac196c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.596133:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac196c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.596142:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100609.596148:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac196c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.596156:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac196c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.596179:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a3c433df400) 00010000:00010000:3.0:1786100609.596183:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786100609.596188:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac196c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.596195:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac196c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100609.596245:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941805824 00000100:00100000:3.0:1786100609.596256:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941805824 00000100:00100000:3.0:1786100609.596332:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 179 00000100:00100000:3.0:1786100609.596346:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+53:11522:x1872861941805824:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786100609.596379:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100609.596400:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1973 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3181 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.596476:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1973 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3181 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.596502:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1973 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3181 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.596526:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a3c433df400) 00010000:00010000:3.0:1786100609.596529:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786100609.596533:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99000, rc 0) 00000100:00100000:3.0:1786100609.596611:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+54:11522:x1872861941805824:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 267us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100609.596621:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 179 00000100:00100000:3.0:1786100609.602983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100609.603131:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941805952 00000100:00100000:0.0:1786100609.603144:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941805952 00000100:00100000:0.0:1786100609.603235:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:0.0:1786100609.603247:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+6:2352:x1872861941805952:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1786100609.603709:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941805952:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 461us (739us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1786100609.603718:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00080000:3.0:1786100609.603828:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786100609.611594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100609.611700:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941806208 00000100:00100000:0.0:1786100609.611711:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941806208 00000100:00100000:0.0:1786100609.615179:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:0.0:1786100609.615207:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+54:11522:x1872861941806208:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786100609.615735:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+55:11522:x1872861941806208:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 538us (4151us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1786100609.616455:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:3.0:1786100609.620775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100609.620890:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941806464 00000100:00100000:0.0:1786100609.620920:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941806464 00000100:00100000:0.0:1786100609.620989:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 180 00000100:00100000:0.0:1786100609.621003:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+55:11522:x1872861941806464:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786100609.621219:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+55:11522:x1872861941806464:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 218us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100609.621228:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 180 00000100:00100000:3.0:1786100609.628990:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100609.629636:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941806592 00000100:00100000:1.0:1786100609.629676:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941806592 00000100:00100000:1.0:1786100609.629745:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 181 00000100:00100000:1.0:1786100609.629757:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+55:11522:x1872861941806592:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786100609.629785:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100609.629813:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac197a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3188 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.630158:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1981 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.630176:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.630188:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100609.630235:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100609.630258:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.630289:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac197a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3188 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.630310:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3188 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.630341:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a3c433df400) 00010000:00010000:1.0:1786100609.630344:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786100609.630349:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f000, rc 0) 00000100:00100000:1.0:1786100609.630691:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+56:11522:x1872861941806592:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 933us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100609.630700:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 181 00000100:00100000:1.0:1786100609.638081:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100609.638512:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941806720 00000100:00100000:0.0:1786100609.638525:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941806720 00000100:00100000:0.0:1786100609.638594:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:0.0:1786100609.638607:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941806720:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786100609.638628:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100609.638674:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e1daa42/0x5564f2c20ac1988 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c318f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786100609.638708:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a75bb80, blocks: 0x1 00010000:00010000:0.0:1786100609.638733:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:0.0:1786100609.638739:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100609.638751:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e1daa42/0x5564f2c20ac1988 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c318f expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.638771:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e1daa42/0x5564f2c20ac1988 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c318f expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.638787:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbba400, rc 0) 00000100:00100000:0.0:1786100609.638854:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941806720:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 250us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100609.638892:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:3.0:1786100609.643992:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100609.644118:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941806976 00000100:00100000:1.0:1786100609.644130:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941806976 00000100:00100000:1.0:1786100609.644202:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 182 00000100:00100000:1.0:1786100609.644214:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+56:11522:x1872861941806976:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786100609.644349:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+56:11522:x1872861941806976:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 137us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100609.644357:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 182 00000100:00100000:0.0:1786100609.647316:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100609.647520:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941807104 00000100:00100000:3.0:1786100609.647533:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941807104 00000100:00100000:3.0:1786100609.647599:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:3.0:1786100609.647610:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:11522:x1872861941807104:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786100609.647631:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100609.647680:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000db32547/0x5564f2c20ac198f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3196 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.647719:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e1daa42/0x5564f2c20ac1988 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c318f expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.647751:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100609.647756:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100609.647762:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000db32547/0x5564f2c20ac198f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3196 expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.647803:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e1daa42/0x5564f2c20ac1988 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c318f expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.647819:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e1daa42/0x5564f2c20ac1988 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c318f expref: 9 pid: 6683 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100609.647835:0:6686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7491b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6686:1872861960676992:192.168.206.53@tcp:104: 00000100:00100000:3.0:1786100609.648092:0:6686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47aa9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786100609.654767:0:6686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7491b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6686:1872861960676992:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100609.654818:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000db32547/0x5564f2c20ac198f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3196 expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.654847:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99c00, rc 0) 00000100:00100000:1.0:1786100609.655255:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+9:11522:x1872861941807104:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 7643us (7949us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100609.655266:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:3.0:1786100609.655781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100609.655961:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941807232 00000100:00100000:2.0:1786100609.655972:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941807232 00010000:00010000:2.0:1786100609.656014:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e1daa42/0x5564f2c20ac1988 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c318f expref: 9 pid: 6683 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100609.656054:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:2.0:1786100609.656064:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+9:2351:x1872861941807232:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100609.656080:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100609.656107:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e1daa42/0x5564f2c20ac1988 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c318f expref: 9 pid: 6683 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.656122:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e1daa42/0x5564f2c20ac1988 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c318f expref: 9 pid: 6683 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.656151:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e1daa42/0x5564f2c20ac1988 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c318f expref: 9 pid: 6683 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.656167:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100609.656172:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100609.656181:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000db32547/0x5564f2c20ac198f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3196 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.656193:0:11178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000db32547/0x5564f2c20ac198f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3196 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.656257:0:11178:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000db32547/0x5564f2c20ac198f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3196 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100609.656275:0:11178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db25180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11178:1872861960677120:192.168.206.53@tcp:105: 00000100:00100000:2.0:1786100609.656353:0:11178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddbaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1786100609.661106:0:11178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db25180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11178:1872861960677120:192.168.206.53@tcp:105: 00010000:00010000:2.0:1786100609.661139:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100609.661277:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+8:2351:x1872861941807232:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 5212us (5496us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100609.661291:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:1.0:1786100609.667081:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100609.668086:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941807360 00000100:00100000:3.0:1786100609.668101:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941807360 00002000:00100000:3.0:1786100609.668167:0:6691:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a3c7491ea00 x1872861941807360/t0(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:140/0 lens 504/0 e 0 to 0 dl 1786100620 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786100609.668181:0:6691:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c7491ea00 with x1872861941807360 ext(0->8) 00002000:00010000:3.0:1786100609.668187:0:6691:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c7491ea00 00000100:00100000:3.0:1786100609.668226:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:3.0:1786100609.668237:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:2351:x1872861941807360:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1786100609.668851:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2a93440-3d3b-4616-8388-e39125c10990+10:2351:x1872861941807360:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 Request processed in 611us (1782us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1786100609.668999:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00002000:00100000:3.0:1786100609.669009:0:6691:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a3c7491ea00 x1872861941807360/t4294967314(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:140/0 lens 504/448 e 0 to 0 dl 1786100620 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786100609.669020:0:6691:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c7491ea00 with x1872861941807360 ext(0->8) 00002000:00010000:3.0:1786100609.669024:0:6691:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c7491ea00 00000100:00100000:1.0:1786100609.672165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100609.674689:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941807488 00000100:00100000:3.0:1786100609.674710:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941807488 00000100:00100000:2.0:1786100609.675291:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 183 00000100:00100000:2.0:1786100609.675304:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7491e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+56:11522:x1872861941807488:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1786100609.772357:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000020:00080000:1.0:1786100609.772384:0:5865:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a3c749003c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1786100609.772390:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c47ef0b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c74900e40 00000020:00080000:1.0:1786100609.772394:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c47ef0900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c7f3ee800 00000004:00080000:1.0:1786100609.772425:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:1.0:1786100609.772481:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1786100609.772550:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1786100609.772568:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7491e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+18:11522:x1872861941807488:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 Request processed in 97258us (100411us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100609.772579:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 183 00000020:00080000:1.0:1786100609.772807:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1786100609.773065:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786100609.773083:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960677248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786100609.773150:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100609.773225:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960677376:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786100609.773347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100609.773386:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960677248 00000100:00100000:1.0:1786100609.773392:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960677248 00000100:00100000:1.0:1786100609.773493:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960677376 00000100:00100000:1.0:1786100609.773496:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960677376 00000100:00100000:1.0:1786100609.773514:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786100609.773522:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960677248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786100609.773717:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1786100609.773721:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1786100608 00002000:00010000:1.0:1786100609.773724:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786100609.773726:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1786100608 -> 1786100608 00002000:00010000:1.0:1786100609.773729:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786100609.773768:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1872861960677248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 245us (617us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1786100609.773775:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786100609.773791:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786100609.773798:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1872861960677376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786100609.773814:0:6683:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1786100609.773843:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a75bb7e, atime: 0x0, ctime: 0x6a75bb7e, blocks: 0xb 00010000:00010000:1.0:1786100609.773852:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4bef1e1/0x5564f2c20ac1996 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.773886:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1786100609.773891:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100609.773898:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4bef1e1/0x5564f2c20ac1996 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.773915:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4bef1e1/0x5564f2c20ac1996 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.773925:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4bef1e1/0x5564f2c20ac1996 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.773933:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4bef1e1/0x5564f2c20ac1996 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.773950:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786100609.778344:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00080000:3.0:1786100609.778404:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786100609.778410:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786100609.778436:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941807616 00000100:00100000:3.0:1786100609.778447:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941807616 00000100:00100000:3.0:1786100609.778512:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 56 00000100:00100000:3.0:1786100609.778524:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+10:2352:x1872861941807616:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1786100609.780588:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1872861960677376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6778us (7227us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1786100609.780605:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:3.0:1786100609.780837:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a3c50d89180/2, rc 0, transno 4294967307 00000100:00100000:3.0:1786100609.780845:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960677376:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1786100609.782959:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100609.782973:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4bef1e1/0x5564f2c20ac1996 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.782990:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100609.782996:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4bef1e1/0x5564f2c20ac1996 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.783008:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4bef1e1/0x5564f2c20ac1996 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.783051:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4bef1e1/0x5564f2c20ac1996 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.783060:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4bef1e1/0x5564f2c20ac1996 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.783084:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100609.783087:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100609.783089:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1786100609.783152:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a3c459ead80/2, rc 0, transno 4294967315 00000100:00100000:2.0:1786100609.783163:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960677248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786100609.812406:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+10:2352:x1872861941807616:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 Request processed in 33872us (34133us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100609.812430:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 56 00000001:00080000:3.0:1786100609.812470:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1786100609.812483:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1786100609.812489:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1786100609.816893:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100609.817042:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941807872 00000100:00100000:1.0:1786100609.817054:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941807872 00000100:00100000:1.0:1786100609.817126:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 184 00000100:00100000:1.0:1786100609.817137:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+18:11522:x1872861941807872:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786100609.817197:0:9953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100609.817234:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1981 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3188 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.817272:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a3c433df400) 00010000:00010000:1.0:1786100609.817278:0:9953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786100609.817311:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac199d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.817326:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac199d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.817336:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac199d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786100609.817604:0:9953:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004faf832e reply state 000000003293c593 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac199d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100609.817616:0:9953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786100609.817830:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+19:11522:x1872861941807872:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 693us (944us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1786100609.817837:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 184 00000100:00100000:1.0:1786100609.824491:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:2.0:1786100609.824733:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac199d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.824748:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac199d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.824756:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac199d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.824763:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100609.824768:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac199d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.824776:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac199d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.824796:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a3c433df400) 00010000:00010000:2.0:1786100609.824819:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100609.824825:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac199d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.824833:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac199d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100609.824882:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941808000 00000100:00100000:2.0:1786100609.824891:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941808000 00000100:00100000:2.0:1786100609.824942:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 57 00000100:00100000:2.0:1786100609.824951:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+7:2351:x1872861941808000:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1786100609.825259:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1786100609.825264:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1786100608 -> 1786100608 00002000:00010000:2.0:1786100609.825266:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1786100606 00002000:00010000:2.0:1786100609.825269:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1786100608 -> 1786100608 00002000:00010000:2.0:1786100609.825271:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1786100609.825338:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:2351:x1872861941808000:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 387us (856us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1786100609.825346:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 57 00000100:00100000:2.0:1786100609.831746:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100609.832142:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941808256 00000100:00100000:0.0:1786100609.832155:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941808256 00000100:00100000:0.0:1786100609.832233:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 185 00000100:00100000:0.0:1786100609.832247:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+18:11522:x1872861941808256:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1786100609.832345:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.832366:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1965 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c317a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.832378:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.832420:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c317a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.832459:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1965 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c317a expref: 18 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100609.832478:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7bfcce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960677504:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100609.832596:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c480e86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100609.839139:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7bfcce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960677504:192.168.206.53@tcp:104: 00010000:00010000:3.0:1786100609.839178:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100609.848217:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100609.848511:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941808384 00000100:00100000:1.0:1786100609.848523:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941808384 00010000:00010000:1.0:1786100609.848573:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1965 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c317a expref: 19 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100609.848622:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 70 00000100:00100000:1.0:1786100609.848633:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+19:2351:x1872861941808384:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100609.848682:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100609.848692:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1965 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c317a expref: 19 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.848722:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c317a expref: 19 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.848749:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1965 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c317a expref: 19 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.848767:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a3c433df400) 00010000:00010000:1.0:1786100609.848774:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.848785:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.848793:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.848822:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786100609.848872:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.848884:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.848979:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.848988:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.848995:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.849002:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbba00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100609.849007:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.849015:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.849025:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a3c433df400) 00010000:00010000:3.0:1786100609.849027:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786100609.849031:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.849038:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100609.849624:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+18:11522:x1872861941808256:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 Request processed in 17377us (17887us total) trans 0 rc -22/-22 00000100:00100000:1.0:1786100609.849625:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+18:2351:x1872861941808384:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 985us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100609.849639:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 70 00000100:00100000:3.0:1786100609.849648:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 185 00000100:00100000:0.0:1786100609.852564:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100609.852714:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941808512 00000100:00100000:2.0:1786100609.852726:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941808512 00000100:00100000:2.0:1786100609.852790:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:2.0:1786100609.852802:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+8:2353:x1872861941808512:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786100609.852857:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.852915:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000db32547/0x5564f2c20ac198f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3196 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.852924:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786100609.852929:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786100609.852933:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.852976:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000db32547/0x5564f2c20ac198f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3196 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.852991:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000db32547/0x5564f2c20ac198f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3196 expref: 8 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100609.853007:0:6683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1872861960677632:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100609.853100:0:6683:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba600 going to sleep for 11 seconds 00000100:00100000:0.0:1786100609.855192:0:6683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1872861960677632:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100609.855230:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100609.859709:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100609.860118:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941808640 00000100:00100000:3.0:1786100609.860131:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941808640 00010000:00010000:3.0:1786100609.860182:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000db32547/0x5564f2c20ac198f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3196 expref: 9 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100609.860235:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:3.0:1786100609.860247:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+9:2352:x1872861941808640:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100609.860266:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100609.860297:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000db32547/0x5564f2c20ac198f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3196 expref: 9 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.860313:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000db32547/0x5564f2c20ac198f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3196 expref: 9 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.860344:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000db32547/0x5564f2c20ac198f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3196 expref: 9 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.860363:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786100609.860368:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786100609.860375:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.860386:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.860552:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100609.860624:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941808640:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 378us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100609.860633:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 71 00010000:00010000:0.0:1786100609.860721:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.860733:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.860764:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.860773:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.860782:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.860799:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100609.860803:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.860813:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.860826:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.860834:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc57c977/0x5564f2c20ac19ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100609.860901:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:2353:x1872861941808512:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 Request processed in 8101us (8353us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100609.860910:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:2.0:1786100609.865316:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100609.865574:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941808896 00000100:00100000:3.0:1786100609.865587:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941808896 00000100:00100000:3.0:1786100609.865740:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 186 00000100:00100000:3.0:1786100609.865753:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+17:11522:x1872861941808896:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786100609.865925:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac19b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.865946:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac19b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.865959:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac19b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.866222:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.866235:0:9953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1973 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3181 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.866244:0:9953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.866289:0:9953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1973 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3181 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100609.866328:0:9953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1973 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3181 expref: 18 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100609.866345:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b43531f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960677760:192.168.206.53@tcp:104: 00000100:00100000:3.0:1786100609.867075:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47aa9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100609.885180:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100609.885336:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941809024 00000100:00100000:0.0:1786100609.885350:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941809024 00010000:00010000:0.0:1786100609.885404:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1973 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3181 expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100609.885457:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00100000:0.0:1786100609.885470:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+19:2352:x1872861941809024:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100609.885494:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100609.885502:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1973 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3181 expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.885538:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1973 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3181 expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.885566:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a3c433df400) 00010000:00010000:0.0:1786100609.885573:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.885584:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.885592:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.885616:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100609.885738:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+19:2352:x1872861941809024:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 270us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100609.885746:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 72 00010000:00010000:2.0:1786100609.888566:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99000/0x5564f2c20ac1973 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3181 expref: 18 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100609.888592:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b43531f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960677760:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100609.888622:0:9953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.894295:0:9953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.894319:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786100609.894589:0:9953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1786100609.894805:0:9953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1786100609.895034:0:9953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1786100609.895152:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9953:1872861960677888:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786100609.895240:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100609.895281:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c51e77600 going to sleep for 11 seconds 00000100:00100000:0.0:1786100609.896069:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960677888 00000100:00100000:0.0:1786100609.896081:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960677888 00000100:00100000:0.0:1786100609.896146:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786100609.896158:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9953:x1872861960677888:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786100609.896274:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9953:x1872861960677888:12345-0@lo:1000:mdt00_003.0 Request processed in 118us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100609.896282:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786100609.896327:0:9953:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1786100609.896334:0:9953:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a3c459ead80, transno 4294967315 00000100:00100000:0.0:1786100609.896349:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9953:1872861960677888:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1786100609.899101:0:9953:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1786100609.899219:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7bfcd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9953:1872861960678016:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786100609.899306:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100609.899348:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c480e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1786100609.899388:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960678016 00000100:00100000:0.0:1786100609.899395:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960678016 00000100:00100000:0.0:1786100609.900629:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786100609.900645:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9953:x1872861960678016:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786100609.901009:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9953:x1872861960678016:12345-0@lo:1000:mdt00_003.0 Request processed in 368us (1701us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1786100609.901018:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786100609.902937:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7bfcd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9953:1872861960678016:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1786100609.903000:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903014:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903023:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903030:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100609.903036:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903045:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903065:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a3c433df400) 00010000:00010000:1.0:1786100609.903068:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786100609.903074:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903081:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99800/0x5564f2c20ac19b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903119:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac18ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903143:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac18ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903149:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac18ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903155:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99a00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100609.903158:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac18ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903165:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac18ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903174:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c454ab500) 00010000:00010000:1.0:1786100609.903177:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786100609.903180:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac18ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903186:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99a00/0x5564f2c20ac18ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903208:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903226:0:9953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac190a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3165 expref: 21 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903235:0:9953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903278:0:9953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac190a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3165 expref: 21 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.903304:0:9953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac190a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3165 expref: 21 pid: 9953 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100609.903321:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960678144:192.168.206.53@tcp:104: 00000100:00100000:1.0:1786100609.903679:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c45810300 going to sleep for 11 seconds 00000100:00100000:3.0:1786100609.908403:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100609.908489:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941809152 00000100:00100000:0.0:1786100609.908500:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941809152 00010000:00010000:0.0:1786100609.908550:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac190a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3165 expref: 22 pid: 9953 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100609.908597:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 73 00000100:00100000:0.0:1786100609.908608:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+22:2351:x1872861941809152:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100609.908626:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100609.908633:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac190a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3165 expref: 22 pid: 9953 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.908676:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac190a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3165 expref: 22 pid: 9953 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.908706:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c454ab500) 00010000:00010000:0.0:1786100609.908712:0:11178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.908735:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.908743:0:11178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.908764:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100609.908824:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+22:2351:x1872861941809152:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 218us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100609.908833:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 73 00010000:00010000:0.0:1786100609.909007:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac190a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3165 expref: 21 pid: 9953 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100609.909027:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960678144:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100609.909049:0:9953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909059:0:9953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909065:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909079:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909086:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909093:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909107:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100609.909112:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909120:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909130:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c454ab500) 00010000:00010000:0.0:1786100609.909133:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100609.909137:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909144:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac19c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909156:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac19b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909162:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac19b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909168:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac19b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909173:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100609.909176:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac19b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909181:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac19b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909199:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c454ab500) 00010000:00010000:0.0:1786100609.909202:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786100609.909204:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac19b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100609.909210:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac19b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100609.909465:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+20:11522:x1872861941808896:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 43713us (44158us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1786100609.909474:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 186 00000020:00080000:0.0:1786100609.909479:0:9953:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1786100609.912316:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100609.912407:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941809408 00000100:00100000:1.0:1786100609.912420:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941809408 00000100:00100000:1.0:1786100609.912485:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:1.0:1786100609.912496:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6af02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+20:11522:x1872861941809408:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1786100609.913188:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786100609.913201:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786100609.913744:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1786100609.913755:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:1.0:1786100609.917402:0:5847:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1786100609.917544:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1786100609.918793:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac19c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.918828:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac19c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.918845:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac19c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.918857:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac19c7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.918880:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac19c7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.918887:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac19c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100609.918935:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786100609.919097:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6af02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+22:11522:x1872861941809408:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 6594us (6787us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1786100609.919112:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 50 00000020:00080000:1.0:1786100609.919120:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786100609.919493:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100609.919504:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac19c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.919514:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fa00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100609.919519:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac19c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.919529:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac19c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.919545:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a3c461b1800) 00010000:00010000:2.0:1786100609.919548:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786100609.919553:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac19c7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.919559:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac19c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100609.919579:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100609.919581:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100609.919583:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786100610.195778:0:12473:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786100610.195792:0:12473:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786100610.195844:0:12473:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1786100610.195871:0:12473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786100610.214695:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100610.343808:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100610.343981:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941809664 00000100:00100000:3.0:1786100610.343994:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941809664 00000100:00100000:3.0:1786100610.344065:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 187 00000100:00100000:3.0:1786100610.344077:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+22:11532:x1872861941809664:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100610.344105:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100610.344129:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac19ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c319d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.344455:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac19d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.344471:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac19d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.344484:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac19d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100610.344497:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000100:00080000:0.0:1786100610.344968:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786100610.345041:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac19ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c319d expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.345077:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac19d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c319d expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.345087:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:3.0:1786100610.345090:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786100610.345094:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99c00, rc 0) 00000100:00100000:3.0:1786100610.345179:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+24:11532:x1872861941809664:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1103us (1381us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1786100610.345187:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 187 00000100:00100000:3.0:1786100610.348575:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100610.348799:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941809792 00000100:00100000:0.0:1786100610.348811:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941809792 00000100:00100000:0.0:1786100610.348890:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 188 00000100:00100000:0.0:1786100610.348902:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+24:11532:x1872861941809792:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:0.0:1786100610.348994:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac19e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349014:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac19e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349026:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac19e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349041:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349058:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349065:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349493:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349503:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349510:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786100610.349561:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349577:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac19e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349584:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac19e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349592:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac19e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349598:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100610.349603:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac19e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349611:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac19e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349631:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:0.0:1786100610.349634:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100610.349639:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac19e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349645:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac19e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349739:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349746:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349752:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349757:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbae00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100610.349760:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349766:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349774:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c433dfe00) 00010000:00010000:0.0:1786100610.349776:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100610.349779:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349785:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349815:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349821:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349827:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349832:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbba00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100610.349835:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349842:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349850:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c433dfc00) 00010000:00010000:0.0:1786100610.349853:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100610.349918:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.349926:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100610.350079:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+24:11532:x1872861941809792:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 1176us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100610.350089:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 188 00000100:00100000:2.0:1786100610.433123:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100610.433279:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941810048 00000100:00100000:0.0:1786100610.433290:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941810048 00000100:00100000:0.0:1786100610.433347:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 189 00000100:00100000:0.0:1786100610.433366:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+24:11535:x1872861941810048:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1786100610.433387:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100610.433426:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.433495:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.433509:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.433521:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.433536:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.433543:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.433549:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436120:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436136:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436147:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100610.436182:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1786100610.436264:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436272:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436279:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436285:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbae00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100610.436289:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436297:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436310:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:0.0:1786100610.436312:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100610.436316:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436321:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac19ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436331:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436336:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436341:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436352:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100610.436355:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436361:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436369:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c433dfc00) 00010000:00010000:0.0:1786100610.436371:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100610.436374:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436378:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436426:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac19f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31a4 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436439:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31a4 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.436446:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:0.0:1786100610.436447:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786100610.436450:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbbe00, rc 0) 00000100:00100000:0.0:1786100610.439276:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+26:11535:x1872861941810048:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 5901us (6148us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1786100610.439288:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 189 00000100:00100000:0.0:1786100610.446593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100610.446677:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941810176 00000100:00100000:1.0:1786100610.446686:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941810176 00000100:00100000:0.0:1786100610.446799:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 190 00000100:00100000:0.0:1786100610.446810:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+26:11535:x1872861941810176:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:0.0:1786100610.446961:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.446978:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.446990:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.447017:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.447024:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.447030:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.447037:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100610.447041:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.447049:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.447061:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:0.0:1786100610.447065:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786100610.447070:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.447087:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100610.447162:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+26:11535:x1872861941810176:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 352us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100610.449599:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 190 00000100:00100000:1.0:1786100610.456508:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100610.456607:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941810432 00000100:00100000:0.0:1786100610.456618:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941810432 00000100:00100000:0.0:1786100610.457203:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:0.0:1786100610.457216:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+26:11535:x1872861941810432:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1786100610.457455:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+27:11535:x1872861941810432:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 242us (954us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1786100610.457463:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:0.0:1786100610.468949:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960678272:0@lo:400:kworker.0 00000100:00100000:0.0:1786100610.469017:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100610.469067:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960678272 00000100:00100000:0.0:1786100610.469074:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786100610.469076:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960678272 00000100:00100000:0.0:1786100610.469079:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1872861960678656:0@lo:400:kworker.0 00000100:00100000:0.0:1786100610.469103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100610.469116:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1786100610.469125:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3306:x1872861960678272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100610.469128:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1872861960678528:0@lo:400:kworker.0 00000100:00100000:0.0:1786100610.469147:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100610.469164:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786100610.469169:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960678400:0@lo:400:kworker.0 00000100:00100000:1.0:1786100610.469172:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3306:x1872861960678272:12345-0@lo:400:kworker.0 Request processed in 49us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100610.469178:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1786100610.469186:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100610.469206:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960678656 00000100:00100000:0.0:1786100610.469209:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960678656 00000100:00100000:0.0:1786100610.469263:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960678528 00000100:00100000:0.0:1786100610.469267:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960678528 00000100:00100000:0.0:1786100610.469278:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960678400 00000100:00100000:0.0:1786100610.469281:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960678400 00000100:00100000:0.0:1786100610.469294:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1786100610.469300:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1872861960678656:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1786100610.469310:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100610.469445:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1786100610.469454:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872861960678528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100610.469502:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872861960678528:12345-0@lo:400:kworker.0 Request processed in 50us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100610.469509:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1786100610.469530:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1786100610.469535:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960678400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100610.469536:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1872861960678528:0@lo:400:kworker.0 00000100:00100000:2.0:1786100610.469564:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960678400:12345-0@lo:400:kworker.0 Request processed in 29us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100610.469567:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960678400:0@lo:400:kworker.0 00000100:00100000:2.0:1786100610.469570:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1786100610.469708:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1872861960678656:0@lo:400:kworker.0 00000100:00100000:1.0:1786100610.469716:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960678272:0@lo:400:kworker.0 00000100:00100000:0.0:1786100610.470020:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1872861960678656:12345-0@lo:400:kworker.0 Request processed in 719us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100610.470027:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1786100610.524161:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100610.524314:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941810688 00000100:00100000:2.0:1786100610.524324:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941810688 00000100:00100000:2.0:1786100610.524486:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 191 00000100:00100000:2.0:1786100610.524506:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+27:11069:x1872861941810688:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1786100610.524530:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100610.524548:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1a22 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31ab expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.524641:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.524685:0:9953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31a4 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.524695:0:9953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.524747:0:9953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31a4 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.524761:0:9953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31a4 expref: 28 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100610.524775:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960678784:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100610.524889:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100610.527413:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960678784:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100610.527442:0:9953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100610.527980:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100610.528269:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941810816 00000100:00100000:2.0:1786100610.528277:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941810816 00010000:00010000:2.0:1786100610.528317:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31a4 expref: 29 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100610.528366:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 74 00000100:00100000:2.0:1786100610.528377:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+29:2351:x1872861941810816:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100610.528392:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100610.528398:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31a4 expref: 29 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.528418:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31a4 expref: 29 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.528442:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31a4 expref: 29 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.528458:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:2.0:1786100610.528463:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.528473:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.528497:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.528522:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786100610.528573:0:9953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.528583:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100610.528601:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:2.0:1786100610.528874:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+29:2351:x1872861941810816:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 497us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100610.528883:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 74 00010000:00010000:3.0:1786100610.529441:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1a22 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ab expref: 29 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.529461:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ab expref: 28 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.529470:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:3.0:1786100610.529472:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786100610.529475:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f600, rc 0) 00000100:00100000:3.0:1786100610.529523:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+28:11069:x1872861941810688:12345-192.168.206.53@tcp:101:bash.0 Request processed in 5013us (5364us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1786100610.529540:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 191 00000100:00100000:3.0:1786100610.536601:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100610.536703:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941811072 00000100:00100000:0.0:1786100610.536713:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941811072 00000100:00100000:0.0:1786100610.536780:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 192 00000100:00100000:0.0:1786100610.536802:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+28:11069:x1872861941811072:12345-192.168.206.53@tcp:36:bash.0 00010000:00010000:0.0:1786100610.537417:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.537434:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.537445:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786100610.537490:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:0.0:1786100610.537515:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bc85d6f reply state 000000008afce043 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100610.537525:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1786100610.537569:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:0.0:1786100610.537926:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+32:11069:x1872861941811072:12345-192.168.206.53@tcp:36:bash.0 Request processed in 1067us (1263us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1786100610.537936:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 192 00000020:00080000:0.0:1786100610.537942:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1786100610.539783:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.539809:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.539818:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.539825:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbba00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100610.539830:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.539839:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.539864:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:3.0:1786100610.539873:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100610.539878:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100610.539885:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100610.541050:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100610.541130:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941811200 00000100:00100000:0.0:1786100610.541140:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941811200 00000100:00100000:0.0:1786100610.541194:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 193 00000100:00100000:0.0:1786100610.541203:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+31:11069:x1872861941811200:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1786100610.541226:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100610.541243:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31b2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.541296:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31b2 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.541310:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31b2 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.541328:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:0.0:1786100610.541332:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786100610.541336:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbba400, rc 0) 00000100:00100000:0.0:1786100610.541387:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+32:11069:x1872861941811200:12345-192.168.206.53@tcp:101:bash.0 Request processed in 184us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100610.541394:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 193 00000100:00100000:0.0:1786100610.545541:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100610.545631:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941811328 00000100:00100000:2.0:1786100610.545641:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941811328 00000100:00100000:2.0:1786100610.545719:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:2.0:1786100610.545730:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+7:11069:x1872861941811328:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1786100610.545755:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100610.545776:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed2a551/0x5564f2c20ac1a45 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31b9 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786100610.545803:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a75bb80, atime: 0x6a75bb7e, ctime: 0x6a75bb80, blocks: 0xb 00010000:00010000:2.0:1786100610.545826:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1786100610.545830:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100610.545838:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed2a551/0x5564f2c20ac1a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31b9 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.545863:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed2a551/0x5564f2c20ac1a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31b9 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.545883:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f200, rc 0) 00000100:00100000:2.0:1786100610.545933:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:11069:x1872861941811328:12345-192.168.206.53@tcp:101:bash.0 Request processed in 205us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100610.545953:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:2.0:1786100610.551320:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100610.551452:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941811456 00000100:00100000:0.0:1786100610.551461:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941811456 00002000:00010000:0.0:1786100610.551496:0:6690:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1786100610.551517:0:6690:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c6db24e00 with x1872861941811456 ext(0->18446744073709551615) 00002000:00010000:0.0:1786100610.551528:0:6690:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c6db24e00. 00000100:00100000:0.0:1786100610.551586:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:0.0:1786100610.551595:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2a93440-3d3b-4616-8388-e39125c10990+8:2351:x1872861941811456:12345-192.168.206.53@tcp:10:bash.0 00002000:00010000:0.0:1786100610.551889:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1786100610.551892:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1786100608 -> 1786100609 00002000:00010000:0.0:1786100610.551895:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1786100606 -> 1786100606 00002000:00010000:0.0:1786100610.551897:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1786100608 -> 1786100609 00002000:00010000:0.0:1786100610.551899:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1786100610.551969:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2a93440-3d3b-4616-8388-e39125c10990+9:2351:x1872861941811456:12345-192.168.206.53@tcp:10:bash.0 Request processed in 361us (641us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1786100610.551976:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00002000:00010000:0.0:1786100610.551979:0:6690:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1786100610.551982:0:6690:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c6db24e00 with x1872861941811456 ext(0->18446744073709551615) 00002000:00010000:0.0:1786100610.551987:0:6690:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c6db24e00. 00000100:00100000:3.0:1786100610.644762:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100610.648041:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941811584 00000100:00100000:2.0:1786100610.648062:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941811584 00000100:00100000:2.0:1786100610.648228:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 194 00000100:00100000:2.0:1786100610.648242:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+32:11549:x1872861941811584:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:2.0:1786100610.648345:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1a4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648364:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1a4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648378:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1a4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648396:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1a53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648404:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648425:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648819:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648832:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648841:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100610.648919:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648934:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1a4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648942:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1a4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648950:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1a4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648957:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100610.648961:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1a4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648969:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1a4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648982:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:2.0:1786100610.648985:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100610.648991:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1a4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.648997:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1a4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649010:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649016:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1a53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649028:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1a53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649034:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51ee00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100610.649037:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1a53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649045:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1a53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649053:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c58043000) 00010000:00010000:2.0:1786100610.649056:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100610.649059:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1a53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649065:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1a53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649083:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649089:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649095:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649101:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51ea00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100610.649104:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649120:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649130:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:2.0:1786100610.649132:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100610.649135:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.649141:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100610.649265:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+32:11549:x1872861941811584:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 1023us (4513us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100610.649274:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 194 00000100:00100000:1.0:1786100610.686092:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100610.686232:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941811840 00000100:00100000:0.0:1786100610.686245:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941811840 00000100:00100000:0.0:1786100610.686316:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 195 00000100:00100000:0.0:1786100610.686327:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+32:11552:x1872861941811840:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1786100610.686351:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100610.686375:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1a61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31c0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.686490:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.686507:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.686526:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.686542:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.686549:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.686556:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.689790:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.689816:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.689832:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100610.689847:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1786100610.689987:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.689996:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690003:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690027:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbba00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100610.690033:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690042:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690056:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:2.0:1786100610.690060:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100610.690065:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690072:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1a68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690089:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690095:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690101:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690107:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100610.690110:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690117:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690137:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c433dfc00) 00010000:00010000:2.0:1786100610.690140:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100610.690143:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690150:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1a6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690213:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1a61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31c0 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690230:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31c0 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.690238:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:2.0:1786100610.690240:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786100610.690243:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51ea00, rc 0) 00000100:00100000:2.0:1786100610.690343:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+34:11552:x1872861941811840:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 4015us (4264us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1786100610.690354:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 195 00000100:00100000:3.0:1786100610.696075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100610.696200:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941811968 00000100:00100000:0.0:1786100610.696212:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941811968 00000100:00100000:0.0:1786100610.696284:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 196 00000100:00100000:0.0:1786100610.696297:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+34:11552:x1872861941811968:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:0.0:1786100610.696388:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.696410:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ab expref: 34 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.696420:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.696491:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ab expref: 34 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.696507:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ab expref: 34 pid: 9953 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100610.696533:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6e09e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960678912:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100610.696680:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47aa9840 going to sleep for 11 seconds 00000100:00100000:0.0:1786100610.699352:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6e09e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960678912:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100610.699396:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100610.699992:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100610.700335:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941812224 00000100:00100000:1.0:1786100610.700346:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941812224 00000100:00100000:1.0:1786100610.700414:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:1.0:1786100610.700425:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+35:5590:x1872861941812224:12345-192.168.206.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1786100610.710043:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+36:5590:x1872861941812224:12345-192.168.206.53@tcp:35:ldlm_bl.0 Request processed in 9603us (10036us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1786100610.710061:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:0.0:1786100610.717369:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100610.717484:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941812352 00000100:00100000:1.0:1786100610.717497:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941812352 00010000:00010000:1.0:1786100610.717550:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ab expref: 36 pid: 9953 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100610.717597:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 75 00000100:00100000:1.0:1786100610.717609:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+36:2351:x1872861941812352:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100610.717627:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100610.717635:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ab expref: 36 pid: 9953 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.717789:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ab expref: 36 pid: 9953 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.717820:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1a29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ab expref: 36 pid: 9953 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.717838:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:1.0:1786100610.717844:0:11178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.717949:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.717956:0:11178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.724107:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100610.724267:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+35:2351:x1872861941812352:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 6648us (6901us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100610.724282:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 75 00010000:00010000:1.0:1786100610.724422:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.724435:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.724485:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.724494:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.724502:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.724509:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbe00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100610.724514:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.724523:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.724542:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:1.0:1786100610.724546:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786100610.724551:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.724579:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac1a84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100610.724634:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+34:11552:x1872861941811968:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 28340us (28575us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100610.724644:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 196 00000100:00100000:3.0:1786100610.732138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100610.732289:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941812608 00000100:00100000:1.0:1786100610.732301:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941812608 00000100:00100000:1.0:1786100610.732368:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:1.0:1786100610.732379:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+34:11552:x1872861941812608:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1786100610.732733:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+35:11552:x1872861941812608:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 354us (607us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1786100610.732742:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:3.0:1786100610.813906:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100610.814159:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941812864 00000100:00100000:2.0:1786100610.814172:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941812864 00000100:00100000:2.0:1786100610.814250:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 197 00000100:00100000:2.0:1786100610.814262:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+35:11563:x1872861941812864:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:2.0:1786100610.814296:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100610.814323:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1a8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31c7 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.814464:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1a92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.814481:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1a92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.814496:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1a92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.814513:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1a99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.814520:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.814527:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815131:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815142:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815151:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100610.815162:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1786100610.815284:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1a92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815292:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1a92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815306:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1a92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815312:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100610.815317:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1a92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815325:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1a92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815338:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:2.0:1786100610.815341:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100610.815347:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1a92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815352:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1a92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815368:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815374:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1a99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815379:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1a99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815383:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51fa00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100610.815386:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1a99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815407:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1a99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815416:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c58043000) 00010000:00010000:2.0:1786100610.815419:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100610.815422:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1a99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815428:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1a99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815482:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1a8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31c7 expref: 38 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815496:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31c7 expref: 37 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.815504:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:2.0:1786100610.815506:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100610.815508:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51ee00, rc 0) 00000100:00100000:2.0:1786100610.815595:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+37:11563:x1872861941812864:12345-192.168.206.53@tcp:101:cat.0 Request processed in 1334us (1703us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1786100610.815604:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 197 00000100:00100000:2.0:1786100610.823055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100610.823405:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941813120 00000100:00100000:1.0:1786100610.823479:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941813120 00000100:00100000:1.0:1786100610.823594:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00100000:1.0:1786100610.823607:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+37:11563:x1872861941813120:12345-192.168.206.53@tcp:35:cat.0 00000100:00100000:0.0:1786100610.824305:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+38:11563:x1872861941813120:12345-192.168.206.53@tcp:35:cat.0 Request processed in 698us (1262us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1786100610.824315:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 54 00000100:00100000:3.0:1786100610.844192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100610.844282:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941813376 00000100:00100000:2.0:1786100610.844295:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941813376 00000100:00100000:2.0:1786100610.844366:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 198 00000100:00100000:2.0:1786100610.844378:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+38:11564:x1872861941813376:12345-192.168.206.53@tcp:36:rm.0 00010000:00010000:2.0:1786100610.844480:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1786100610.844514:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31c7 expref: 38 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.844541:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1a76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31c0 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.844554:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1a3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31b2 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.844567:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:2.0:1786100610.844579:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100610.844604:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1aae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.844618:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1aae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.844643:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1aae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.844708:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1ab5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.844715:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.844722:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.845124:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1abc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.845134:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1abc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.845142:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1abc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786100610.845880:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1786100610.845892:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352088240624ns, next at 353088237302ns, rc = 0 00010000:00010000:2.0:1786100610.845961:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1ac3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.845973:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.845984:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.845993:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1ac3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846000:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1ac3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846006:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1ac3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846035:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786100610.846061:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1abc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846075:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1abc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846082:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1abc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846089:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100610.846094:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1abc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846103:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1abc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846115:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:2.0:1786100610.846118:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786100610.846123:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1abc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846129:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1abc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.846137:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100610.846147:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1aae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.846148:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1ac3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846154:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1aae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.846155:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100610.846159:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1ac3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846160:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1aae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846165:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100610.846166:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1ac3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846174:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1aae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846181:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1aae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.846186:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a3c58043400) 00010000:00010000:2.0:1786100610.846188:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:1.0:1786100610.846188:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786100610.846190:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100610.846191:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1ac3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846193:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1aae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.846197:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f600/0x5564f2c20ac1ac3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.846200:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1aae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100610.846208:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da6f9837 reply state 00000000ba596a63 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.846214:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100610.846215:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100610.846217:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100610.846218:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786100610.846374:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+37:11564:x1872861941813376:12345-192.168.206.53@tcp:36:rm.0 Request processed in 1994us (2193us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1786100610.846383:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 198 00010000:00010000:2.0:1786100610.848280:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.848299:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1ab5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.848306:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1ab5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.848313:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51fa00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100610.848385:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1ab5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.848408:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1ab5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.848424:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c58043000) 00010000:00010000:2.0:1786100610.848427:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100610.848432:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1ab5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.848437:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1ab5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100610.910068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100610.910198:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941813632 00000100:00100000:2.0:1786100610.910210:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941813632 00000100:00100000:2.0:1786100610.910284:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 199 00000100:00100000:2.0:1786100610.910296:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+36:11570:x1872861941813632:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1786100610.910332:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100610.910357:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1aca lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31ce expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.910527:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1ad1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.910544:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.910556:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.910572:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1ad8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.910596:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.910604:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786100610.912196:0:9953:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1786100610.912553:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.912571:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.912584:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.912954:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.912964:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1ad1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.912972:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1ad1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.912978:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100610.912982:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1ad1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.912990:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1ad1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.913022:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:2.0:1786100610.913025:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100610.913031:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1ad1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.913038:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1ad1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100610.913054:0:9953:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000373f3827 reply state 00000000e21a7cfb transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100610.913065:0:9953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786100610.913111:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1aca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ce expref: 39 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.913127:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ce expref: 38 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.913134:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043a00) 00010000:00010000:2.0:1786100610.913137:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100610.913139:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51ea00, rc 0) 00000100:00100000:2.0:1786100610.913240:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+39:11570:x1872861941813632:12345-192.168.206.53@tcp:101:bash.0 Request processed in 2945us (3185us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1786100610.913250:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 199 00010000:00010000:0.0:1786100610.916360:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.916500:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1ad8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.916509:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.916516:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100610.916522:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.916548:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1ad8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.916568:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c58043000) 00010000:00010000:0.0:1786100610.916572:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100610.916578:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1ad8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.916584:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1ad8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100610.921912:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100610.922290:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941813760 00000100:00100000:0.0:1786100610.922302:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941813760 00000100:00080000:1.0:1786100610.922519:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786100610.922581:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:0.0:1786100610.922596:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+5:2353:x1872861941813760:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1786100610.922620:0:9414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100610.922646:0:9414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1aed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31d5 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786100610.922703:0:9414:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786100610.922821:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1786100610.922827:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100610.922838:0:9414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1aed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31d5 expref: 6 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.922929:0:9414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1aed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31d5 expref: 6 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100610.922971:0:9414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb400, rc 0) 00000100:00100000:0.0:1786100610.923506:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+6:2353:x1872861941813760:12345-192.168.206.53@tcp:101:bash.0 Request processed in 911us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100610.923517:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:0.0:1786100610.931114:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100610.931217:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941813888 00000100:00100000:2.0:1786100610.931230:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941813888 00000100:00100000:2.0:1786100610.931326:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:2.0:1786100610.931338:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:11570:x1872861941813888:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1786100610.931382:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100610.931412:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31dc expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.931453:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1aed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31d5 expref: 7 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.931464:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100610.931469:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100610.931475:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.931516:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1aed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31d5 expref: 7 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.931532:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1aed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31d5 expref: 7 pid: 9414 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100610.931549:0:6686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6686:1872861960679040:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100610.931920:0:6686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba240 going to sleep for 11 seconds 00000100:00100000:0.0:1786100610.936004:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100610.936202:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941814016 00000100:00100000:1.0:1786100610.936214:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941814016 00010000:00010000:1.0:1786100610.936261:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1aed lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31d5 expref: 8 pid: 9414 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100610.936314:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:1.0:1786100610.936325:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:2351:x1872861941814016:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100610.936343:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100610.936371:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1aed lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31d5 expref: 8 pid: 9414 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.936388:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1aed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31d5 expref: 8 pid: 9414 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.936419:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100610.936439:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100610.936449:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.936460:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100610.936502:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100610.936525:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1872861960679168:192.168.206.53@tcp:105: 00000100:00100000:1.0:1786100610.936613:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c45810780 going to sleep for 11 seconds 00010000:00010000:2.0:1786100610.941395:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1aed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31d5 expref: 8 pid: 9414 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100610.941441:0:6686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6686:1872861960679040:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100610.941481:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100610.941525:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51fa00, rc 0) 00000100:00100000:2.0:1786100610.941616:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+7:11570:x1872861941813888:12345-192.168.206.53@tcp:101:bash.0 Request processed in 10279us (10515us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100610.941626:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:1.0:1786100610.945279:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1872861960679168:192.168.206.53@tcp:105: 00000100:00100000:3.0:1786100610.945836:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100610.946000:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941814272 00000100:00100000:0.0:1786100610.946009:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941814272 00000100:00100000:0.0:1786100610.946116:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 55 00000100:00100000:0.0:1786100610.946131:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+38:11570:x1872861941814272:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:0.0:1786100610.946606:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+39:11570:x1872861941814272:12345-192.168.206.53@tcp:35:bash.0 Request processed in 478us (771us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1786100610.946614:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 55 00010000:00010000:1.0:1786100610.946990:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100610.947024:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941814016:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 10699us (11032us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100610.947033:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:0.0:1786100610.984349:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960679296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100610.984425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100610.984696:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786100610.984716:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960679424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786100610.984783:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100610.984829:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960679296 00000100:00100000:2.0:1786100610.984837:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960679296 00000100:00100000:3.0:1786100610.984945:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960679424 00000100:00100000:3.0:1786100610.984950:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960679424 00000100:00100000:3.0:1786100610.984972:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786100610.984982:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1872861960679296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786100610.985025:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100610.985088:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1872861960679296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100610.985096:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786100610.985115:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786100610.985121:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1872861960679424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786100610.985143:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100610.985194:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1872861960679424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100610.985201:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1786100610.985246:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960679296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100610.985302:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960679424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100611.079194:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100611.079326:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941814400 00000100:00100000:1.0:1786100611.079338:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941814400 00000100:00100000:1.0:1786100611.079413:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 200 00000100:00100000:1.0:1786100611.079425:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+39:11586:x1872861941814400:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100611.079456:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100611.079481:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1afb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31e3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.079581:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1b02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.079598:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.079610:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100611.079805:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1786100611.079810:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100611.079839:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.079879:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1afb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31e3 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.079901:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1b02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31e3 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.079910:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:1.0:1786100611.079914:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100611.079918:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f800, rc 0) 00000100:00100000:1.0:1786100611.079998:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+40:11586:x1872861941814400:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 573us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100611.080005:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 200 00000100:00100000:2.0:1786100611.087598:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100611.087700:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941814656 00000100:00100000:1.0:1786100611.087716:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941814656 00000100:00100000:1.0:1786100611.087818:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 201 00000100:00100000:1.0:1786100611.087831:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+40:11586:x1872861941814656:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100611.087873:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100611.087899:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1b09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31ea expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.088030:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.088045:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.088057:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100611.088070:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1786100611.088223:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1b09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ea expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.088244:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ea expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.088252:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043a00) 00010000:00010000:1.0:1786100611.088256:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786100611.088259:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165fa00, rc 0) 00000100:00100000:1.0:1786100611.088341:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+42:11586:x1872861941814656:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 513us (760us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1786100611.088349:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 201 00000100:00100000:3.0:1786100611.091845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100611.091945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100611.092054:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941815040 00000100:00100000:0.0:1786100611.092063:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941815040 00000100:00100000:0.0:1786100611.092124:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:0.0:1786100611.092134:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+42:2352:x1872861941815040:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100611.092150:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100611.092176:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ea expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100611.092213:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043a00) 00010000:00010000:0.0:1786100611.092218:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100611.092269:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+41:2352:x1872861941815040:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 136us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100611.092276:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:1.0:1786100611.095068:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941814912 00000100:00100000:1.0:1786100611.095097:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941814912 00000100:00100000:1.0:1786100611.095224:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 202 00000100:00100000:1.0:1786100611.095235:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+41:11586:x1872861941814912:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100611.095263:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100611.095284:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1b1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31f1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.095384:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1b25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.095399:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.095423:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100611.095435:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1786100611.095557:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1b1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31f1 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.095576:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1b25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31f1 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.095584:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043a00) 00010000:00010000:1.0:1786100611.095587:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786100611.095599:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165fc00, rc 0) 00000100:00100000:1.0:1786100611.095843:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+43:11586:x1872861941814912:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 609us (4007us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1786100611.095864:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 202 00000100:00100000:3.0:1786100611.101484:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.101639:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941815168 00000100:00100000:2.0:1786100611.101683:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941815168 00000100:00100000:2.0:1786100611.101729:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:2.0:1786100611.101738:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+6:2351:x1872861941815168:12345-192.168.206.53@tcp:1:lfs.0 00010000:00010000:2.0:1786100611.101779:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.101798:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.101806:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100611.101810:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786100611.101815:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.102122:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.102137:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 6 pid: 6686 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100611.102153:0:6683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1872861960679552:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100611.102238:0:6683:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba240 going to sleep for 11 seconds 00000100:00100000:0.0:1786100611.110524:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.110640:0:6683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1872861960679552:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100611.110689:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100611.110835:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941815296 00000100:00100000:3.0:1786100611.110844:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941815296 00002000:00100000:3.0:1786100611.110903:0:6689:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a3c6e09ce00 x1872861941815296/t0(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:142/0 lens 504/0 e 0 to 0 dl 1786100622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786100611.110932:0:6689:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c6e09ce00 with x1872861941815296 ext(0->8) 00010000:00010000:3.0:1786100611.110940:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 7 pid: 6686 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100611.110954:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 7 pid: 6686 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786100611.110962:0:6689:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a3c6e09ce00 00000100:00100000:3.0:1786100611.111003:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:3.0:1786100611.111012:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941815296:12345-192.168.206.53@tcp:4:lfs.0 00000100:00100000:3.0:1786100611.111457:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d2a93440-3d3b-4616-8388-e39125c10990+9:2352:x1872861941815296:12345-192.168.206.53@tcp:4:lfs.0 Request processed in 444us (941us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1786100611.111466:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00002000:00100000:3.0:1786100611.111474:0:6689:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a3c6e09ce00 x1872861941815296/t4294967308(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:142/0 lens 504/448 e 0 to 0 dl 1786100622 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786100611.111482:0:6689:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c6e09ce00 with x1872861941815296 ext(0->8) 00010000:00010000:3.0:1786100611.111488:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 9 pid: 6686 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100611.111499:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 9 pid: 6686 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786100611.111505:0:6689:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a3c6e09ce00 00000100:00100000:1.0:1786100611.119814:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100611.119936:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941815424 00000100:00100000:0.0:1786100611.119946:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941815424 00010000:00010000:0.0:1786100611.119993:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 9 pid: 6686 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100611.120033:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00100000:0.0:1786100611.120049:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+9:2354:x1872861941815424:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100611.120064:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786100611.120081:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1786100611.120084:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1786100610 00002000:00010000:0.0:1786100611.120087:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1786100610 00002000:00010000:0.0:1786100611.120089:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1786100610 00010000:00010000:0.0:1786100611.120096:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 9 pid: 6686 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100611.120111:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 9 pid: 6686 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100611.120135:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3469aa1/0x5564f2c20ac1af4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31dc expref: 9 pid: 6686 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100611.120167:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786100611.120172:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786100611.120177:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100611.120187:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100611.120228:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100611.120285:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+8:2354:x1872861941815424:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 236us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100611.120293:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 77 00010000:00010000:2.0:1786100611.120633:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.120644:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.120706:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.120716:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.120738:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.120746:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51ee00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100611.120751:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.120761:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.120776:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.120785:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c19aca7/0x5564f2c20ac1b33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100611.120833:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:2351:x1872861941815168:12345-192.168.206.53@tcp:1:lfs.0 Request processed in 19095us (19357us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100611.120840:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:1.0:1786100611.124314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.124387:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941815680 00000100:00100000:2.0:1786100611.124396:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941815680 00000100:00100000:2.0:1786100611.124460:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 56 00000100:00100000:2.0:1786100611.124470:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6af01c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+43:11586:x1872861941815680:12345-192.168.206.53@tcp:35:lfs.0 00000004:00010000:2.0:1786100611.124526:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1b25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31f1 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786100611.124805:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1786100611.124862:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1786100611.125516:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1786100611.125568:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.125584:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1adf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ce expref: 47 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.126277:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.126317:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ce expref: 47 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.126332:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1adf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ce expref: 47 pid: 9953 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100611.126349:0:5846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1872861960679680:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100611.126484:0:5846:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba240 going to sleep for 11 seconds 00000100:00100000:0.0:1786100611.134052:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100611.134234:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941815808 00000100:00100000:3.0:1786100611.134254:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941815808 00010000:00010000:3.0:1786100611.134293:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1adf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ce expref: 48 pid: 9953 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100611.134333:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 78 00000100:00100000:3.0:1786100611.134343:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+48:2352:x1872861941815808:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100611.134357:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100611.134364:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1adf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ce expref: 48 pid: 9953 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100611.134378:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1adf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ce expref: 48 pid: 9953 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100611.134401:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043a00) 00010000:00010000:3.0:1786100611.134417:0:11178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100611.134427:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100611.134434:0:11178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100611.134453:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100611.134507:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+48:2352:x1872861941815808:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 165us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100611.134513:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 78 00010000:00010000:2.0:1786100611.136266:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac1adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ce expref: 47 pid: 9953 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100611.136288:0:5846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1872861960679680:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100611.136309:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.136334:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.136341:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786100611.136522:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1786100611.136832:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1786100611.136964:0:5846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1872861960679808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786100611.137023:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100611.137055:0:5846:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba840 going to sleep for 11 seconds 00000100:00100000:0.0:1786100611.137223:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960679808 00000100:00100000:0.0:1786100611.137231:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960679808 00000100:00100000:0.0:1786100611.137295:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1786100611.137305:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5846:x1872861960679808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786100611.137381:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5846:x1872861960679808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 78us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100611.137389:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1786100611.137467:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786100611.137585:0:5846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1872861960679808:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1786100611.138172:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1786100611.138237:0:5846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1872861960679936:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786100611.138272:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100611.138292:0:5846:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba240 going to sleep for 11 seconds 00000100:00100000:0.0:1786100611.138684:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960679936 00000100:00100000:0.0:1786100611.138691:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960679936 00000100:00100000:0.0:1786100611.138726:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786100611.138735:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5846:x1872861960679936:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786100611.138916:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5846:x1872861960679936:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 182us (642us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1786100611.138941:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786100611.139099:0:5846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1872861960679936:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1786100611.139146:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1786100611.139188:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.139198:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.139205:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.139212:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100611.139216:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.139223:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.139238:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043a00) 00010000:00010000:1.0:1786100611.139241:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1786100611.139245:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.139252:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac1b3a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786100611.139435:0:5846:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1786100611.139563:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1786100611.139580:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352381928731ns, next at 353381927007ns, rc = 0 00000001:00080000:1.0:1786100611.139587:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1786100611.139620:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043a00) 00010000:00010000:1.0:1786100611.139622:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786100611.139629:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1b25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31f1 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100611.139747:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6af01c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+50:11586:x1872861941815680:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 15279us (15441us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1786100611.139756:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 56 00000020:00080000:1.0:1786100611.139761:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1786100611.144497:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.145065:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941815936 00000100:00100000:2.0:1786100611.145078:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941815936 00000100:00100000:2.0:1786100611.145174:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 203 00000100:00100000:2.0:1786100611.145184:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+50:11586:x1872861941815936:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100611.145432:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100611.145458:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1b41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31f8 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.145514:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1b41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31f8 expref: 51 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.145549:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1b41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31f8 expref: 51 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.145570:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100611.145573:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786100611.145802:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51ee00, rc 0) 00000100:00100000:2.0:1786100611.145972:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+51:11586:x1872861941815936:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 788us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100611.145980:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 203 00000100:00100000:1.0:1786100611.149575:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100611.149692:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941816192 00000100:00100000:0.0:1786100611.149702:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941816192 00000100:00100000:0.0:1786100611.149749:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 57 00000100:00100000:0.0:1786100611.149759:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+51:11586:x1872861941816192:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1786100611.150093:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+52:11586:x1872861941816192:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 334us (525us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1786100611.150101:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 57 00010000:00010000:2.0:1786100611.237628:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100611.277257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.277354:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941816320 00000100:00100000:2.0:1786100611.277364:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941816320 00000100:00100000:2.0:1786100611.277429:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 204 00000100:00100000:2.0:1786100611.277440:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+52:11596:x1872861941816320:12345-192.168.206.53@tcp:34:lfs.0 00010000:00010000:2.0:1786100611.277509:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277528:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277540:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277554:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277562:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277585:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277737:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277745:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277751:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100611.277788:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277800:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277806:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277812:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277818:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100611.277822:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277829:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277841:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:2.0:1786100611.277862:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100611.277869:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277876:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277889:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277895:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277901:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277907:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51ec00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100611.277910:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277915:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277923:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c58043e00) 00010000:00010000:2.0:1786100611.277925:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100611.277928:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277934:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277949:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277962:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277968:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277974:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100611.277976:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277982:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.277989:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100611.277992:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100611.277995:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.278000:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100611.278080:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+52:11596:x1872861941816320:12345-192.168.206.53@tcp:34:lfs.0 Request processed in 641us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100611.278088:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 204 00000100:00100000:2.0:1786100611.323719:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100611.323894:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941816576 00000100:00100000:1.0:1786100611.323903:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941816576 00000100:00100000:1.0:1786100611.324002:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 205 00000100:00100000:1.0:1786100611.324014:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+52:11599:x1872861941816576:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100611.324044:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100611.324066:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1b5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c31ff expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324134:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324148:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324160:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324188:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1b6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324196:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324203:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324318:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1b72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324327:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324334:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100611.324344:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1786100611.324429:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324437:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324445:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324452:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fa00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100611.324456:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324480:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324494:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:1.0:1786100611.324497:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100611.324501:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324682:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1b64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324695:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324701:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1b6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324708:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1b6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324712:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100611.324715:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1b6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324721:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1b6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324728:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c461b1100) 00010000:00010000:1.0:1786100611.324731:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100611.324734:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1b6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324749:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1b6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324790:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1b5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ff expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324803:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ff expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.324809:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:1.0:1786100611.324811:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786100611.324814:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f000, rc 0) 00000100:00100000:1.0:1786100611.324887:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+54:11599:x1872861941816576:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 874us (1175us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1786100611.324895:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 205 00000100:00100000:3.0:1786100611.327988:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.328212:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941816704 00000100:00100000:2.0:1786100611.328221:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941816704 00000100:00100000:2.0:1786100611.328277:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 206 00000100:00100000:2.0:1786100611.328287:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+54:11599:x1872861941816704:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:2.0:1786100611.328368:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.328384:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.328395:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.328421:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.328428:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.328436:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.328442:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100611.328447:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.328454:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.328466:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100611.328469:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786100611.328473:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.328480:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100611.328566:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+54:11599:x1872861941816704:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 279us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100611.328575:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 206 00000100:00100000:3.0:1786100611.335062:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100611.335309:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941816960 00000100:00100000:0.0:1786100611.335319:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941816960 00000100:00100000:0.0:1786100611.335375:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:0.0:1786100611.335386:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+54:11599:x1872861941816960:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:0.0:1786100611.335616:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+55:11599:x1872861941816960:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 231us (561us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1786100611.335624:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 58 00000100:00100000:3.0:1786100611.442403:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.442518:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941817216 00000100:00100000:2.0:1786100611.442527:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941817216 00000100:00100000:2.0:1786100611.442591:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 207 00000100:00100000:2.0:1786100611.442601:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+55:11609:x1872861941817216:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1786100611.442626:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100611.442630:0:9953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786100611.442680:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1b02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31e3 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.442700:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:2.0:1786100611.442704:0:9953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100611.442728:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3206 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.442822:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.442836:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.442846:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100611.442866:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1786100611.442987:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1b87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3206 expref: 57 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.443017:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3206 expref: 56 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.443026:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100611.443029:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100611.443031:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51ec00, rc 0) 00000100:00100000:2.0:1786100611.443088:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+56:11609:x1872861941817216:12345-192.168.206.53@tcp:101:bash.0 Request processed in 489us (695us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1786100611.443096:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 207 00000100:00100000:3.0:1786100611.446562:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100611.446875:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941817344 00000100:00100000:0.0:1786100611.446885:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941817344 00000100:00100000:0.0:1786100611.446950:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:0.0:1786100611.446961:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+56:2351:x1872861941817344:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100611.446979:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100611.447004:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ec00/0x5564f2c20ac1b8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3206 expref: 56 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100611.447027:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:0.0:1786100611.447033:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100611.447110:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+55:2351:x1872861941817344:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 150us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100611.447118:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:3.0:1786100611.447964:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.448084:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941817600 00000100:00100000:2.0:1786100611.448090:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941817600 00000100:00100000:2.0:1786100611.448132:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 208 00000100:00100000:2.0:1786100611.448140:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b43531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+55:11609:x1872861941817600:12345-192.168.206.53@tcp:36:bash.0 00010000:00010000:2.0:1786100611.448193:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100611.448212:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1b72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31ff expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.448226:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100611.448230:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100611.448425:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.448439:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.448449:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786100611.448510:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1786100611.448534:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000993106ea reply state 000000004912f89b transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100611.448543:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786100611.448816:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b43531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+57:11609:x1872861941817600:12345-192.168.206.53@tcp:36:bash.0 Request processed in 675us (854us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1786100611.448824:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 208 00000020:00080000:2.0:1786100611.448828:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786100611.450245:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.450257:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.450264:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.450271:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100611.450275:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.450282:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.450296:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100611.450299:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100611.450302:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.450308:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1b9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100611.450929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.451029:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941817728 00000100:00100000:2.0:1786100611.451042:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941817728 00000100:00100000:2.0:1786100611.451152:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 209 00000100:00100000:2.0:1786100611.451163:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+56:11609:x1872861941817728:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:2.0:1786100611.451187:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100611.451202:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1ba3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c320d expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.451286:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1baa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.451300:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.451311:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100611.451336:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1786100611.451340:0:9953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100611.451356:0:9953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.451379:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1ba3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c320d expref: 58 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.451393:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1baa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c320d expref: 57 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.451401:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100611.451413:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100611.451416:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51fc00, rc 0) 00000100:00100000:2.0:1786100611.451472:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+57:11609:x1872861941817728:12345-192.168.206.53@tcp:101:bash.0 Request processed in 310us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100611.451479:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 209 00000100:00100000:3.0:1786100611.454384:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100611.454732:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941817984 00000100:00100000:0.0:1786100611.454742:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941817984 00000100:00100000:0.0:1786100611.454785:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:0.0:1786100611.454796:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+57:11609:x1872861941817984:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:0.0:1786100611.455032:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+58:11609:x1872861941817984:12345-192.168.206.53@tcp:35:bash.0 Request processed in 237us (654us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1786100611.455039:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 59 00000100:00100000:3.0:1786100611.544491:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100611.544598:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941818112 00000100:00100000:1.0:1786100611.544607:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941818112 00000100:00100000:1.0:1786100611.544681:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 210 00000100:00100000:1.0:1786100611.544693:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+58:11615:x1872861941818112:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100611.544716:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100611.544746:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3214 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.544811:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1bb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.544825:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.544868:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100611.544928:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1786100611.544932:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100611.544954:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.544981:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3214 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.544998:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3214 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.545007:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:1.0:1786100611.545010:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100611.545014:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165e000, rc 0) 00000100:00100000:1.0:1786100611.545373:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+59:11615:x1872861941818112:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 680us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100611.545382:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 210 00000100:00100000:3.0:1786100611.551475:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100611.551682:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941818240 00000100:00100000:1.0:1786100611.551692:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941818240 00000100:00100000:1.0:1786100611.551748:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 211 00000100:00100000:1.0:1786100611.551759:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+59:11615:x1872861941818240:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100611.551780:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100611.551800:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1bbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c321b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.551902:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1bc6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.551916:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.551927:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.551943:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1bcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.551950:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.551957:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.552055:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1bd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.552064:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.552070:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100611.552104:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1786100611.552108:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100611.553024:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553058:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553069:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553076:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1bc6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553085:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553091:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fa00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100611.553096:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553105:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1bc6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553120:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:1.0:1786100611.553125:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100611.553129:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1bc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553137:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1bc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553152:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553160:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1bcd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553177:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1bcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553183:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100611.553187:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1bcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553194:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1bcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553202:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c461b1100) 00010000:00010000:1.0:1786100611.553205:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100611.553207:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1bcd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553213:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1bcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553252:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1bbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c321b expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553266:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c321b expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.553273:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:1.0:1786100611.553275:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786100611.553277:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f000, rc 0) 00000100:00100000:1.0:1786100611.553350:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+60:11615:x1872861941818240:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1590us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100611.553370:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 211 00000100:00100000:3.0:1786100611.560538:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100611.560593:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.560736:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941818624 00000100:00100000:2.0:1786100611.560745:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941818624 00000100:00100000:2.0:1786100611.560810:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:2.0:1786100611.560824:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+60:2353:x1872861941818624:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100611.560840:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100611.560881:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1bd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c321b expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.560901:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100611.560905:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100611.560963:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+59:2353:x1872861941818624:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 139us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100611.560971:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:1.0:1786100611.561135:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941818496 00000100:00100000:1.0:1786100611.561140:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941818496 00000100:00100000:1.0:1786100611.561185:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 212 00000100:00100000:1.0:1786100611.561196:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+59:11615:x1872861941818496:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100611.561217:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100611.561236:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1bdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3222 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.561338:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.561357:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1baa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c320d expref: 60 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.561370:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.561407:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1baa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c320d expref: 60 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.561425:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1baa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c320d expref: 60 pid: 9953 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100611.561438:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960680064:192.168.206.53@tcp:104: 00000100:00100000:1.0:1786100611.561511:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c45810e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786100611.565725:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960680064:192.168.206.53@tcp:104: 00010000:00010000:1.0:1786100611.565776:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100611.573536:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100611.576100:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941818752 00000100:00100000:0.0:1786100611.576115:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941818752 00010000:00010000:0.0:1786100611.576164:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1baa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c320d expref: 61 pid: 9953 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100611.576200:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 79 00000100:00100000:0.0:1786100611.576210:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47d75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+61:2351:x1872861941818752:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100611.576226:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100611.576233:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1baa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c320d expref: 61 pid: 9953 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100611.576247:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1baa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c320d expref: 61 pid: 9953 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100611.576271:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1baa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c320d expref: 61 pid: 9953 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100611.576305:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:0.0:1786100611.576310:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100611.576320:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100611.576327:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100611.576372:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100611.576441:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47d75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+60:2351:x1872861941818752:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 232us (2913us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100611.576449:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 79 00010000:00010000:2.0:1786100611.576725:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.576736:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100611.576764:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1786100611.576922:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1bdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3222 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.576953:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3222 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.576960:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100611.576963:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786100611.576966:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165e400, rc 0) 00000100:00100000:2.0:1786100611.577009:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+60:11615:x1872861941818496:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 15814us (16482us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1786100611.577017:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 212 00000100:00100000:3.0:1786100611.582787:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.583121:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941819008 00000100:00100000:2.0:1786100611.583130:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941819008 00000100:00100000:2.0:1786100611.583194:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:2.0:1786100611.583205:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+60:11615:x1872861941819008:12345-192.168.206.53@tcp:103:lfs.0 00010000:00010000:2.0:1786100611.583221:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100611.583247:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1b41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31f8 expref: 60 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.583265:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100611.583270:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100611.583323:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+59:11615:x1872861941819008:12345-192.168.206.53@tcp:103:lfs.0 Request processed in 120us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100611.583332:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:3.0:1786100611.594059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.594327:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941819136 00000100:00100000:2.0:1786100611.594338:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941819136 00000100:00100000:2.0:1786100611.594402:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 213 00000100:00100000:2.0:1786100611.594425:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+59:11615:x1872861941819136:12345-192.168.206.53@tcp:58:lfs.0 00010000:00010000:2.0:1786100611.594525:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1bf0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.594542:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.594554:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786100611.594788:0:9953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1786100611.594888:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+59:11615:x1872861941819136:12345-192.168.206.53@tcp:58:lfs.0 Request processed in 463us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100611.594896:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 213 00000100:00100000:3.0:1786100611.599773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.600137:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941819264 00000100:00100000:2.0:1786100611.600147:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941819264 00000100:00100000:2.0:1786100611.600210:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 214 00000100:00100000:2.0:1786100611.600220:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+59:11615:x1872861941819264:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100611.600241:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100611.600261:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1bf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3229 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.600318:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1bf0 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.600330:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1bf7 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3229 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.600350:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.600377:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1bf7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3229 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.600391:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100611.600395:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786100611.600399:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1bf7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3229 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.600420:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f800, rc 0) 00000100:00100000:2.0:1786100611.600481:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+60:11615:x1872861941819264:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 262us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100611.600488:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 214 00000040:00080000:2.0:1786100611.940904:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786100611.940913:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786100611.941077:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1786100611.941083:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786100611.941198:0:11696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d89880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1872861960680192:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786100611.941352:0:11696:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100611.946218:0:11696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d89880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1872861960680192:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786100611.948997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.949363:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941819392 00000100:00100000:2.0:1786100611.949372:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941819392 00000100:00100000:2.0:1786100611.949439:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 215 00000100:00100000:2.0:1786100611.949450:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+60:11616:x1872861941819392:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786100611.949481:0:9953:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786100611.949577:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+60:11616:x1872861941819392:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 128us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100611.949598:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 215 00000100:00100000:3.0:1786100611.957287:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.957747:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941819520 00000100:00100000:2.0:1786100611.957758:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941819520 00000100:00100000:2.0:1786100611.957819:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 216 00000100:00100000:2.0:1786100611.957830:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+60:11616:x1872861941819520:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1786100611.957910:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1bfe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.957925:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1bfe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.957937:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1bfe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.957952:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1c05 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.957960:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1c05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.957967:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1c05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.957990:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1c0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.957998:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958005:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100611.958053:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1786100611.958058:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100611.958071:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958081:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1bfe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958088:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1bfe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958094:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1bfe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958100:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100611.958104:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1bfe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958112:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1bfe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958124:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df900) 00010000:00010000:2.0:1786100611.958128:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100611.958132:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1bfe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958139:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f000/0x5564f2c20ac1bfe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958157:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1c05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958171:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1c05 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958177:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1c05 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958182:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100611.958186:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1c05 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958192:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1c05 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958199:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9a3c58043e00) 00010000:00010000:2.0:1786100611.958202:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100611.958204:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1c05 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958210:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e400/0x5564f2c20ac1c05 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958224:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958229:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1c0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958234:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958239:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51fe00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100611.958247:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958261:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1c0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958279:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100611.958281:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100611.958284:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1c0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.958290:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fe00/0x5564f2c20ac1c0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100611.958369:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+60:11616:x1872861941819520:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 Request processed in 540us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100611.958378:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 216 00000100:00100000:3.0:1786100611.965514:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.967385:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941819776 00000100:00100000:2.0:1786100611.967399:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941819776 00000100:00100000:2.0:1786100611.967596:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 217 00000100:00100000:2.0:1786100611.967607:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+60:11616:x1872861941819776:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786100611.967628:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100611.967669:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3230 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.967765:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.967779:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.967808:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100611.967820:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1786100611.967928:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.967936:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.967943:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.967949:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51fc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100611.967952:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.967960:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.967973:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100611.967976:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786100611.967981:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.967987:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.968028:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c13 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3230 expref: 62 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.968050:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df900) 00010000:00010000:2.0:1786100611.968052:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786100611.968056:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3230 expref: 62 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100611.968066:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f400, rc 0) 00000100:00100000:2.0:1786100611.968137:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+61:11616:x1872861941819776:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 533us (2632us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1786100611.968144:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 217 00000100:00100000:3.0:1786100611.975222:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100611.975813:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941819904 00000100:00100000:2.0:1786100611.975824:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941819904 00000100:00100000:2.0:1786100611.976016:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 218 00000100:00100000:2.0:1786100611.976026:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+61:11616:x1872861941819904:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786100611.976059:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786100611.976245:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+61:11616:x1872861941819904:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 219us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100611.976254:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 218 00000100:00100000:3.0:1786100611.985991:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100611.988975:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941820160 00000100:00100000:1.0:1786100611.988990:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941820160 00000100:00100000:1.0:1786100611.989143:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 219 00000100:00100000:1.0:1786100611.989156:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+61:11616:x1872861941820160:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786100611.989178:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100611.989181:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786100611.989210:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e000/0x5564f2c20ac1bb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3214 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.989232:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:1.0:1786100611.989237:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786100611.989252:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1c28 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3237 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786100611.989736:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1786100611.989957:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1c2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.989971:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.989981:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.990031:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1c28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3237 expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.990068:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3237 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.990076:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a3c461b1100) 00010000:00010000:1.0:1786100611.990078:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786100611.990081:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f800, rc 0) 00000100:00100000:1.0:1786100611.990149:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+62:11616:x1872861941820160:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 995us (4166us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1786100611.990157:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 219 00000100:00100000:3.0:1786100611.997354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100611.997838:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941820416 00000100:00100000:1.0:1786100611.997862:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941820416 00000100:00100000:1.0:1786100611.997927:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 220 00000100:00100000:1.0:1786100611.997938:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+62:11616:x1872861941820416:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786100611.998018:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100611.998047:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1c2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3237 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998068:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a3c461b1100) 00010000:00010000:1.0:1786100611.998079:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786100611.998102:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1c3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998115:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1c3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998124:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1c3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998147:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1c44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x2b802d8c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998155:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1c44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b802d8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998162:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1c44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b802d8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998239:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1c3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998247:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1c3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998253:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1c3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998260:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100611.998275:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1c3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998283:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1c3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998291:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:1.0:1786100611.998294:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100611.998298:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1c3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998304:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1c3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998319:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1c44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b802d8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998325:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1c44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b802d8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998331:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1c44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b802d8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998336:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100611.998339:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1c44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b802d8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998345:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1c44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2b802d8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998353:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x2b802d8c (ffff9a3c461b1800) 00010000:00010000:1.0:1786100611.998355:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100611.998358:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1c44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2b802d8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100611.998364:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f000/0x5564f2c20ac1c44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2b802d8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100611.998952:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+61:11616:x1872861941820416:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 1012us (1604us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786100611.998961:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 220 00000100:00100000:3.0:1786100612.007189:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100612.007222:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941820544 00000100:00100000:3.0:1786100612.007231:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941820544 00000100:00100000:3.0:1786100612.007296:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 221 00000100:00100000:3.0:1786100612.007308:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+61:11616:x1872861941820544:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786100612.007328:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100612.007350:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1c4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c323e expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.007417:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1c52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.007429:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.007440:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.007529:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1c4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c323e expref: 63 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.007547:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c323e expref: 62 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.007556:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:3.0:1786100612.007559:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786100612.007563:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99400, rc 0) 00000100:00100000:3.0:1786100612.007615:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+62:11616:x1872861941820544:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 311us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100612.007881:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 221 00000100:00080000:3.0:1786100612.007907:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100612.010537:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.010970:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941820800 00000100:00100000:2.0:1786100612.010981:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941820800 00000100:00100000:2.0:1786100612.011034:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 222 00000100:00100000:2.0:1786100612.011045:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+62:11616:x1872861941820800:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786100612.011120:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.011136:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.011160:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786100612.011513:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1786100612.011523:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353253871594ns, next at 354253869334ns, rc = 0 00000004:00010000:2.0:1786100612.011603:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eec9c3d2 reply state 0000000023c1cf8c transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100612.011613:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786100612.011982:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+64:11616:x1872861941820800:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 938us (1452us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1786100612.011991:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 222 00000100:00100000:3.0:1786100612.016189:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:0.0:1786100612.016523:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.016537:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.016546:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.016553:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100612.016558:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.016566:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.016603:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:0.0:1786100612.016607:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786100612.016612:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.016619:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f400/0x5564f2c20ac1c59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100612.016806:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941820928 00000100:00100000:2.0:1786100612.016817:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941820928 00000100:00100000:2.0:1786100612.016884:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 223 00000100:00100000:2.0:1786100612.016895:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+63:11616:x1872861941820928:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786100612.016921:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100612.016942:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3245 expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.017009:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3245 expref: 64 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.017024:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3245 expref: 64 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.017042:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:2.0:1786100612.017051:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786100612.017055:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51fc00, rc 0) 00000100:00100000:2.0:1786100612.018005:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+64:11616:x1872861941820928:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 1107us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100612.018015:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 223 00000100:00100000:3.0:1786100612.021842:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.021986:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941821056 00000100:00100000:2.0:1786100612.021997:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941821056 00000100:00100000:2.0:1786100612.022066:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:2.0:1786100612.022077:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+9:2351:x1872861941821056:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1786100612.022396:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+10:2351:x1872861941821056:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 320us (561us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1786100612.022416:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00080000:3.0:1786100612.022685:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786100612.027439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100612.027560:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941821312 00000100:00100000:0.0:1786100612.027571:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941821312 00000100:00100000:0.0:1786100612.027629:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:0.0:1786100612.027640:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+64:11616:x1872861941821312:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786100612.028636:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+65:11616:x1872861941821312:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 993us (1200us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1786100612.028647:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 60 00000100:00100000:0.0:1786100612.031693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100612.031784:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941821568 00000100:00100000:1.0:1786100612.031794:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941821568 00000100:00100000:1.0:1786100612.031876:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 224 00000100:00100000:1.0:1786100612.031886:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+65:11616:x1872861941821568:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786100612.031997:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+65:11616:x1872861941821568:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 112us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100612.032005:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 224 00000100:00100000:2.0:1786100612.035331:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100612.035437:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941821696 00000100:00100000:0.0:1786100612.035447:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941821696 00000100:00100000:0.0:1786100612.035503:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 225 00000100:00100000:0.0:1786100612.035513:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+65:11616:x1872861941821696:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786100612.035532:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100612.035553:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1c67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c324c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.035623:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1c6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.035686:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.035699:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100612.035747:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786100612.035765:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.035792:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac1c67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c324c expref: 67 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.035809:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1c6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c324c expref: 66 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.035818:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:0.0:1786100612.035821:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786100612.035825:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbbc00, rc 0) 00000100:00100000:0.0:1786100612.035936:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+66:11616:x1872861941821696:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 424us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100612.035944:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 225 00000100:00100000:3.0:1786100612.039917:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100612.040022:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941821824 00000100:00100000:0.0:1786100612.040032:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941821824 00000100:00100000:0.0:1786100612.040089:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00100000:0.0:1786100612.040098:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+10:2352:x1872861941821824:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786100612.040114:0:9414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100612.040135:0:9414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac1c75 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3253 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786100612.040162:0:9414:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a75bb83, blocks: 0x1 00010000:00010000:0.0:1786100612.040182:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1786100612.040197:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100612.040207:0:9414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac1c75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3253 expref: 11 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.040225:0:9414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac1c75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3253 expref: 11 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.040238:0:9414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbae00, rc 0) 00000100:00100000:0.0:1786100612.040295:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+11:2352:x1872861941821824:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 198us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100612.040302:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00100000:2.0:1786100612.043754:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100612.043856:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941822080 00000100:00100000:1.0:1786100612.043873:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941822080 00000100:00100000:1.0:1786100612.043934:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 226 00000100:00100000:1.0:1786100612.043945:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+66:11616:x1872861941822080:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786100612.044049:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+66:11616:x1872861941822080:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 107us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100612.044057:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 226 00000100:00100000:3.0:1786100612.046609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.046737:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941822208 00000100:00100000:2.0:1786100612.046747:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941822208 00000100:00100000:2.0:1786100612.046797:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:2.0:1786100612.046807:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7bf57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+11:11616:x1872861941822208:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786100612.046825:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100612.046845:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006305f328/0x5564f2c20ac1c7c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c325a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.046891:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac1c75 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3253 expref: 12 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.046907:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100612.046911:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100612.046918:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006305f328/0x5564f2c20ac1c7c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c325a expref: 12 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.046955:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac1c75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3253 expref: 12 pid: 9414 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.046968:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac1c75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3253 expref: 12 pid: 9414 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100612.046983:0:6684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d89c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1872861960680320:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100612.047077:0:6684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba240 going to sleep for 11 seconds 00000100:00100000:3.0:1786100612.050542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100612.050627:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941822336 00000100:00100000:0.0:1786100612.050648:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941822336 00010000:00010000:0.0:1786100612.050725:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac1c75 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3253 expref: 13 pid: 9414 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100612.050757:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:0.0:1786100612.050767:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+13:2351:x1872861941822336:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100612.050783:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100612.050806:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac1c75 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3253 expref: 13 pid: 9414 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.050820:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac1c75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3253 expref: 13 pid: 9414 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.050862:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100612.050882:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100612.050894:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006305f328/0x5564f2c20ac1c7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c325a expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.050903:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006305f328/0x5564f2c20ac1c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c325a expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.050940:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006305f328/0x5564f2c20ac1c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c325a expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100612.050954:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6e09f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1872861960680448:192.168.206.53@tcp:105: 00000100:00100000:0.0:1786100612.051029:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c51e77000 going to sleep for 11 seconds 00010000:00010000:2.0:1786100612.051694:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da8bedfc/0x5564f2c20ac1c75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3253 expref: 13 pid: 9414 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100612.051710:0:6684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d89c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1872861960680320:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100612.051735:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006305f328/0x5564f2c20ac1c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c325a expref: 12 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.051746:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f000, rc 0) 00000100:00100000:2.0:1786100612.051787:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7bf57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+12:11616:x1872861941822208:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 4981us (5186us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100612.051807:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:3.0:1786100612.057689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.057817:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941822464 00000100:00100000:2.0:1786100612.057827:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941822464 00002000:00100000:2.0:1786100612.057890:0:6690:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9a3c7c126a00 x1872861941822464/t0(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:143/0 lens 504/0 e 0 to 0 dl 1786100623 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786100612.057901:0:6690:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c7c126a00 with x1872861941822464 ext(0->12) 00002000:00010000:2.0:1786100612.057906:0:6690:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c7c126a00 00000100:00100000:2.0:1786100612.057938:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:2.0:1786100612.057948:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2a93440-3d3b-4616-8388-e39125c10990+12:2351:x1872861941822464:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786100612.058352:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d2a93440-3d3b-4616-8388-e39125c10990+14:2351:x1872861941822464:12345-192.168.206.53@tcp:4:lhsmtool_posix.0 Request processed in 404us (705us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1786100612.058360:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00002000:00100000:2.0:1786100612.058367:0:6690:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9a3c7c126a00 x1872861941822464/t4294967320(0) o4->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:143/0 lens 504/448 e 0 to 0 dl 1786100623 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786100612.058375:0:6690:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3c7c126a00 with x1872861941822464 ext(0->12) 00002000:00010000:2.0:1786100612.058378:0:6690:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3c7c126a00 00000100:00100000:0.0:1786100612.058804:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6e09f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1872861960680448:192.168.206.53@tcp:105: 00010000:00010000:0.0:1786100612.058828:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100612.058878:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a93440-3d3b-4616-8388-e39125c10990+13:2351:x1872861941822336:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 8112us (8344us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100612.058886:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:3.0:1786100612.062438:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100612.062529:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941822592 00000100:00100000:0.0:1786100612.062538:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941822592 00000100:00100000:0.0:1786100612.062594:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 227 00000100:00100000:0.0:1786100612.062605:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+66:11616:x1872861941822592:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1786100612.096707:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+66:11616:x1872861941822592:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 Request processed in 34095us (34267us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100612.096720:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 227 00000001:00080000:2.0:1786100612.098924:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:2.0:1786100612.098959:0:5865:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a3c480e8c00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1786100612.098964:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c47ef0200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c480e8300 00000020:00080000:2.0:1786100612.098967:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c47ef0700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c74914800 00000004:00080000:2.0:1786100612.098997:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1786100612.099027:0:5865:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1786100612.099034:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:2.0:1786100612.099078:0:5865:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a3c6ddba840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1786100612.099081:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c60283b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c6ddbad80 00000020:00080000:2.0:1786100612.099084:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c60283200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c7f45c000 00000004:00080000:2.0:1786100612.099102:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:2.0:1786100612.099504:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960680576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786100612.099562:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100612.099626:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960680704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786100612.099676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100612.099700:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786100612.099706:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6e09f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960680832:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786100612.099728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100612.099757:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960680576 00000100:00100000:2.0:1786100612.099764:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960680576 00000100:00100000:2.0:1786100612.099810:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960680704 00000100:00100000:2.0:1786100612.099813:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960680704 00000100:00100000:2.0:1786100612.099825:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960680832 00000100:00100000:2.0:1786100612.099827:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960680832 00000100:00100000:2.0:1786100612.099841:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000020:00080000:1.0:1786100612.099941:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1786100612.100126:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1786100612.100186:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786100612.100196:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1872861960680704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1786100612.100491:0:9414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1786100612.100495:0:9414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1786100611 00002000:00010000:0.0:1786100612.100498:0:9414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786100612.100500:0:9414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1786100611 -> 1786100611 00002000:00010000:0.0:1786100612.100502:0:9414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1786100612.100566:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3305:x1872861960680704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 372us (913us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1786100612.100574:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786100612.100591:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786100612.100598:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3305:x1872861960680832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1786100612.100613:0:9414:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1786100612.100637:0:9414:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a75bb82, atime: 0x6a75bb82, ctime: 0x6a75bb82, blocks: 0x1 00010000:00010000:0.0:1786100612.100645:0:9414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1c83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.100681:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1786100612.100686:0:9414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100612.100692:0:9414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1c83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.100707:0:9414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1c83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.100716:0:9414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1c83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.100734:0:9414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1c83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.100750:0:9414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786100612.100973:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a3c50d89c00/2, rc 0, transno 4294967321 00000100:00100000:1.0:1786100612.100980:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960680704:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1786100612.101078:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100612.101084:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1c83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100612.101092:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100612.101097:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1c83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100612.101107:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1c83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100612.101130:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1c83 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100612.101138:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003074a9ef/0x5564f2c20ac1c83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100612.101154:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100612.101156:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100612.101158:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100612.101193:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1872861960680576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786100612.101209:0:6683:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1786100612.101222:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.101237:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed2a551/0x5564f2c20ac1a45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31b9 expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.101245:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1786100612.101253:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786100612.101258:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786100612.101683:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786100612.101768:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed2a551/0x5564f2c20ac1a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31b9 expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.101783:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed2a551/0x5564f2c20ac1a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31b9 expref: 12 pid: 6686 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100612.101799:0:6683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7ba2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1872861960680960:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100612.102369:0:6683:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba240 going to sleep for 11 seconds 00000004:00080000:3.0:1786100612.102520:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a3c6e09f100/2, rc 0, transno 4294967310 00000100:00100000:3.0:1786100612.102526:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6e09f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960680832:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1786100612.105058:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3305:x1872861960680832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1663us (2532us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1786100612.105079:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1786100612.105526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100612.105587:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941822720 00000100:00100000:1.0:1786100612.105595:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941822720 00000100:00100000:1.0:1786100612.105643:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:1.0:1786100612.105679:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+13:2351:x1872861941822720:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1786100612.110580:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.111016:0:6683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7ba2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1872861960680960:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100612.111042:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100612.111149:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941822848 00000100:00100000:2.0:1786100612.111157:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941822848 00010000:00010000:2.0:1786100612.111189:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed2a551/0x5564f2c20ac1a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31b9 expref: 14 pid: 6686 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100612.111290:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:3.0:1786100612.111301:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+14:2351:x1872861941822848:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100612.111316:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100612.111322:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed2a551/0x5564f2c20ac1a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31b9 expref: 14 pid: 6686 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.111336:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed2a551/0x5564f2c20ac1a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31b9 expref: 14 pid: 6686 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.111359:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed2a551/0x5564f2c20ac1a45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c31b9 expref: 14 pid: 6686 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.111508:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786100612.111514:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786100612.111520:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.111530:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.111570:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100612.111750:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+13:2351:x1872861941822848:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 448us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100612.111759:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 81 00010000:00010000:2.0:1786100612.111765:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.111774:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.111912:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.111922:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.111946:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786100612.111968:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100612.111974:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.111982:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51ea00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100612.111986:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.111995:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.112007:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.112014:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bf17ccd/0x5564f2c20ac1c8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.112028:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100612.112030:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100612.112031:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100612.112453:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3308:x1872861960680576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12603us (12888us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1786100612.112462:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1786100612.112494:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a3c50d8b480/2, rc 0, transno 4294967322 00000100:00100000:3.0:1786100612.112501:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960680576:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786100612.128845:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+12:2351:x1872861941822720:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 Request processed in 23183us (23310us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100612.128872:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 69 00000001:00080000:3.0:1786100612.129174:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1786100612.129186:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:3.0:1786100612.129194:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1786100612.133444:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.133893:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941823104 00000100:00100000:2.0:1786100612.133914:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941823104 00000100:00100000:2.0:1786100612.133979:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 228 00000100:00100000:2.0:1786100612.133990:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+20:11616:x1872861941823104:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786100612.134041:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100612.134068:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1c6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c324c expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.134087:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:2.0:1786100612.134092:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100612.134120:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1c91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.134133:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.134159:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100612.134381:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9bf6cff reply state 0000000053b0ec4b transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100612.134390:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786100612.134890:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+21:11616:x1872861941823104:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 900us (1453us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1786100612.134899:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 228 00010000:00010000:3.0:1786100612.140369:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.140386:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1c91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.140395:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1c91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.140402:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51fa00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100612.140409:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1c91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.140418:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1c91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.140435:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:3.0:1786100612.140439:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100612.140442:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1c91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100612.140523:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:3.0:1786100612.140713:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac1c91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100612.141243:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941823232 00000100:00100000:0.0:1786100612.141252:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941823232 00000100:00100000:0.0:1786100612.141377:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 70 00000100:00100000:0.0:1786100612.141392:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7ba2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941823232:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1786100612.141582:0:9414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1786100612.141585:0:9414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1786100611 -> 1786100610 00002000:00010000:0.0:1786100612.141587:0:9414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1786100610 00002000:00010000:0.0:1786100612.141590:0:9414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1786100611 -> 1786100610 00002000:00010000:0.0:1786100612.141592:0:9414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1786100612.141670:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7ba2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941823232:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 284us (1150us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1786100612.142509:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 70 00000100:00100000:1.0:1786100612.144325:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.144483:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941823488 00000100:00100000:2.0:1786100612.144494:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941823488 00000100:00100000:2.0:1786100612.144597:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 229 00000100:00100000:2.0:1786100612.144607:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+20:11616:x1872861941823488:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1786100612.144715:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.144732:0:9953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1c52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c323e expref: 20 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.144742:0:9953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.144778:0:9953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c323e expref: 20 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.144793:0:9953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1c52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c323e expref: 20 pid: 9953 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100612.144823:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbf9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960681088:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100612.144905:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100612.147434:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbf9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9953:1872861960681088:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100612.147459:0:9953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100612.148877:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.150219:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941823616 00000100:00100000:2.0:1786100612.150230:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941823616 00010000:00010000:2.0:1786100612.150753:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1c52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c323e expref: 21 pid: 9953 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100612.150787:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 82 00000100:00100000:2.0:1786100612.150799:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+21:2352:x1872861941823616:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100612.150815:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100612.150822:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1c52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c323e expref: 21 pid: 9953 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.150836:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c323e expref: 21 pid: 9953 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.150871:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1c52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c323e expref: 21 pid: 9953 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.150888:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:2.0:1786100612.150892:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.150913:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.150920:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.150948:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100612.150999:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+20:2352:x1872861941823616:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 203us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100612.151007:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 82 00010000:00010000:3.0:1786100612.151221:0:9953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.151229:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.151266:0:9953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.151828:0:9953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.151837:0:9953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.151843:0:9953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100612.151860:0:9953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.151870:0:9953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.151882:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:3.0:1786100612.151885:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786100612.151889:0:9953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.151896:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac1c98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100612.152144:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+19:11616:x1872861941823488:12345-192.168.206.53@tcp:55:lhsmtool_posix.0 Request processed in 7535us (7871us total) trans 0 rc -22/-22 00000100:00100000:1.0:1786100612.152154:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 229 00000100:00100000:1.0:1786100612.156951:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.159736:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941823744 00000100:00100000:2.0:1786100612.159750:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941823744 00000100:00100000:2.0:1786100612.159804:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:2.0:1786100612.159815:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+8:2353:x1872861941823744:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786100612.159868:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.159888:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006305f328/0x5564f2c20ac1c7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c325a expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.159897:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100612.159902:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786100612.159907:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.159941:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006305f328/0x5564f2c20ac1c7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c325a expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.159971:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006305f328/0x5564f2c20ac1c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c325a expref: 8 pid: 6684 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100612.159987:0:6683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7fbf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1872861960681216:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100612.160083:0:6683:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100612.165480:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.165480:0:6683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7fbf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1872861960681216:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100612.165507:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100612.165680:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941823872 00000100:00100000:0.0:1786100612.165688:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941823872 00010000:00010000:0.0:1786100612.165722:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006305f328/0x5564f2c20ac1c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c325a expref: 9 pid: 6684 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100612.165755:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 83 00000100:00100000:0.0:1786100612.165777:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+9:2352:x1872861941823872:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100612.165792:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100612.165814:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006305f328/0x5564f2c20ac1c7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c325a expref: 9 pid: 6684 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.165827:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006305f328/0x5564f2c20ac1c7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c325a expref: 9 pid: 6684 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.165864:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006305f328/0x5564f2c20ac1c7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c325a expref: 9 pid: 6684 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.165880:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786100612.165884:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786100612.165889:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.165898:0:11178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.165928:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100612.166039:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.166048:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.166070:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.166078:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.166085:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.166104:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100612.166108:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.166117:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.166129:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.166136:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005babae83/0x5564f2c20ac1c9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100612.166200:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941823872:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 423us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100612.166208:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 83 00000100:00100000:2.0:1786100612.170100:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:2353:x1872861941823744:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 Request processed in 10275us (13145us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100612.170114:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 71 00000100:00100000:2.0:1786100612.173370:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100612.173450:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941824128 00000100:00100000:0.0:1786100612.173472:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941824128 00000100:00100000:0.0:1786100612.173578:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 230 00000100:00100000:0.0:1786100612.173589:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+19:11616:x1872861941824128:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786100612.173760:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1ca6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.173801:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.173820:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.174110:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.174129:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3245 expref: 20 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.174138:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.174189:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3245 expref: 20 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.174206:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3245 expref: 20 pid: 9953 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100612.174222:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6e09d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960681344:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100612.174328:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ded5900 going to sleep for 11 seconds 00000100:00100000:0.0:1786100612.176348:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6e09d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960681344:192.168.206.53@tcp:104: 00010000:00010000:0.0:1786100612.176383:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100612.180336:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100612.184961:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941824256 00000100:00100000:1.0:1786100612.185002:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941824256 00010000:00010000:0.0:1786100612.185156:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3245 expref: 21 pid: 9953 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100612.185217:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 84 00000100:00100000:0.0:1786100612.185228:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+21:2351:x1872861941824256:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100612.185243:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100612.185249:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3245 expref: 21 pid: 9953 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.185262:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3245 expref: 21 pid: 9953 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.185287:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac1c60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3245 expref: 21 pid: 9953 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.185304:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:0.0:1786100612.185310:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.185320:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.185326:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.185367:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786100612.185417:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100612.185431:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a93440-3d3b-4616-8388-e39125c10990+20:2351:x1872861941824256:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 199us (5104us total) trans 0 rc 0/0 00010000:00010000:1.0:1786100612.185436:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100612.185454:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 84 00000001:00080000:1.0:1786100612.185730:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1786100612.185950:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1786100612.186006:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1786100612.186582:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1872861960681472:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786100612.186694:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100612.186824:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960681472 00000100:00100000:0.0:1786100612.186837:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960681472 00000100:00100000:0.0:1786100612.186908:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786100612.186917:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1872861960681472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786100612.187017:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1872861960681472:12345-0@lo:1000:mdt00_001.0 Request processed in 102us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100612.187025:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786100612.188231:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c45810180 going to sleep for 11 seconds 00000100:00100000:0.0:1786100612.188264:0:5844:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1786100612.188269:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1786100612.188288:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a3c50d89c00, transno 4294967321 00000100:00100000:0.0:1786100612.188310:0:5844:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a3c50d8b480 x1872861960680576/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786100628 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100612.188324:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1872861960681472:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1786100612.188972:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1786100612.189047:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6e09d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1872861960681600:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786100612.189096:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100612.189129:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4838e300 going to sleep for 11 seconds 00000100:00100000:1.0:1786100612.189172:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960681600 00000100:00100000:1.0:1786100612.189188:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960681600 00000100:00100000:1.0:1786100612.189259:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786100612.189271:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1872861960681600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786100612.189606:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5844:x1872861960681600:12345-0@lo:1000:mdt00_001.0 Request processed in 332us (504us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1786100612.189615:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786100612.190325:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6e09d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1872861960681600:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1786100612.190372:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190383:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190409:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190415:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100612.190419:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190427:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190442:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:0.0:1786100612.190445:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786100612.190449:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190455:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190483:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1bf0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190489:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1bf0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190494:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1bf0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190498:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51ee00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100612.190501:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1bf0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190516:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1bf0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190524:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:0.0:1786100612.190526:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786100612.190532:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1bf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3229 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190542:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1bf7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3229 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190550:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3229 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.190584:0:5844:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3229 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100612.190598:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6e09c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960681728:192.168.206.53@tcp:105: 00000100:00100000:0.0:1786100612.190694:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4802ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1786100612.200972:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100612.201076:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941824384 00000100:00100000:1.0:1786100612.201092:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941824384 00000100:00100000:1.0:1786100612.201173:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:1.0:1786100612.201186:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+24:11615:x1872861941824384:12345-192.168.206.53@tcp:49:lfs.0 00000100:00100000:1.0:1786100612.201356:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+24:11615:x1872861941824384:12345-192.168.206.53@tcp:49:lfs.0 Request processed in 171us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100612.201364:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 61 00000100:00100000:1.0:1786100612.205646:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100612.205765:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941824640 00000100:00100000:3.0:1786100612.205777:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941824640 00000100:00100000:3.0:1786100612.205907:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 231 00000100:00100000:3.0:1786100612.205921:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+24:11615:x1872861941824640:12345-192.168.206.53@tcp:58:lfs.0 00000040:00080000:2.0:1786100612.206454:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1786100612.206581:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+24:11615:x1872861941824640:12345-192.168.206.53@tcp:58:lfs.0 Request processed in 657us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100612.206817:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6e09c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1872861960681728:192.168.206.53@tcp:105: 00010000:00010000:0.0:1786100612.206858:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1bf0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.206870:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac1bf0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.206901:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207389:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207405:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207416:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207423:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cb4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207430:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207437:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100612.207440:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207448:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cb4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207459:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:0.0:1786100612.207463:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100612.207466:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cb4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207473:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cb4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207484:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207498:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1ca6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207503:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1ca6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207509:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100612.207512:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1ca6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207519:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1ca6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207527:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:0.0:1786100612.207529:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786100612.207533:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1ca6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.207539:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1ca6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100612.207814:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+24:11616:x1872861941824128:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 34225us (34457us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1786100612.209336:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 231 00000100:00100000:0.0:1786100612.209373:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 230 00000020:00080000:0.0:1786100612.209385:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1786100612.209977:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786100612.209983:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786100612.210042:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1786100612.210047:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786100612.210157:0:11696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c745d2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1872861960681856:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786100612.210236:0:11696:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6ddba600 going to sleep for 11 seconds 00000100:00100000:1.0:1786100612.215431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.215558:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941824896 00000100:00100000:2.0:1786100612.215570:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941824896 00000100:00100000:2.0:1786100612.216096:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 62 00000100:00100000:2.0:1786100612.216112:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6af03450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+24:11616:x1872861941824896:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1786100612.217384:0:5846:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:0.0:1786100612.217751:0:11696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c745d2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1872861960681856:192.168.206.53@tcp:107:hsm_cdtr.0 00000001:00080000:2.0:1786100612.218145:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1786100612.218215:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1cbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.218234:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.218248:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.218257:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1cbb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.218264:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1cbb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.218271:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1cbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.218298:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786100612.218444:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100612.218461:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1cbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.218469:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100612.218473:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1cbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.218482:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1cbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.218497:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a3c58043100) 00010000:00010000:3.0:1786100612.218501:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1786100612.218508:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6af03450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+25:11616:x1872861941824896:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 2301us (2990us total) trans 4294967515 rc 0/0 00010000:00010000:3.0:1786100612.218509:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1cbb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.218520:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e800/0x5564f2c20ac1cbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.218540:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100612.218542:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100612.218543:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100612.218841:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 62 00000020:00080000:2.0:1786100612.218905:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786100612.220337:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.220463:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941825024 00000100:00100000:2.0:1786100612.220475:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941825024 00000100:00100000:2.0:1786100612.220596:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 232 00000100:00100000:2.0:1786100612.220609:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+25:11617:x1872861941825024:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786100612.220695:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786100612.220831:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+25:11617:x1872861941825024:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 224us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100612.220840:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 232 00000100:00100000:1.0:1786100612.227767:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100612.229263:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941825280 00000100:00100000:0.0:1786100612.229280:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941825280 00000100:00100000:0.0:1786100612.229364:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 233 00000100:00100000:0.0:1786100612.229394:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+25:11617:x1872861941825280:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786100612.229427:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100612.229453:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1cc2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3261 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.232131:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.232158:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.232171:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100612.232189:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1786100612.232368:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac1cc2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3261 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.232448:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3261 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100612.232458:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:0.0:1786100612.232461:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786100612.232465:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbbc00, rc 0) 00000100:00100000:0.0:1786100612.232604:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2a93440-3d3b-4616-8388-e39125c10990+27:11617:x1872861941825280:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 3212us (4861us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1786100612.232615:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 233 00000100:00100000:2.0:1786100612.243379:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.243507:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100612.243835:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941825536 00000100:00100000:1.0:1786100612.243856:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941825536 00000100:00100000:1.0:1786100612.245173:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941825664 00000100:00100000:1.0:1786100612.245189:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941825664 00000100:00100000:3.0:1786100612.245354:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 234 00000100:00100000:3.0:1786100612.245370:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+28:11617:x1872861941825536:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786100612.245473:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1cd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.245495:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.245509:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.245802:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.245812:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1cd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.245820:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1cd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.245827:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98e00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100612.245832:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1cd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.245840:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1cd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.245865:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:3.0:1786100612.245868:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786100612.245874:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1cd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.245881:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98e00/0x5564f2c20ac1cd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100612.246075:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+29:11617:x1872861941825536:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 706us (2711us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1786100612.246083:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 234 00000100:00100000:3.0:1786100612.246108:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 235 00000100:00100000:3.0:1786100612.246117:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+28:11619:x1872861941825664:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100612.246140:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100612.246155:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1cde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3268 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.246209:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1ce5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.246221:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.246229:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.246245:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1cec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.246252:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.246258:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.246618:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac1cf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.246631:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3222 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.246640:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac1cf3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.246728:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3222 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.246754:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3222 expref: 29 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100612.246771:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c124380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960681984:192.168.206.53@tcp:104: 00000100:00100000:3.0:1786100612.246843:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f58e600 going to sleep for 11 seconds 00000040:00080000:0.0:1786100612.250206:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786100612.250217:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786100612.251078:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1786100612.251096:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786100612.255634:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c124380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1872861960681984:192.168.206.53@tcp:104: 00010000:00010000:3.0:1786100612.255708:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac1cf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100612.257261:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100612.257304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100612.257534:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941825920 00000100:00100000:3.0:1786100612.257546:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941825920 00000100:00100000:3.0:1786100612.257597:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941826176 00000100:00100000:3.0:1786100612.257600:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941826176 00000100:00100000:3.0:1786100612.257617:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:3.0:1786100612.257628:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+31:11617:x1872861941825920:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786100612.257972:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+32:11617:x1872861941825920:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 344us (721us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1786100612.257979:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 63 00000100:00100000:3.0:1786100612.258007:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 64 00000100:00100000:3.0:1786100612.258015:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+31:5589:x1872861941826176:12345-192.168.206.53@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1786100612.258120:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+32:5589:x1872861941826176:12345-192.168.206.53@tcp:35:ldlm_bl.0 Request processed in 105us (814us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1786100612.258127:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 64 00010000:00010000:0.0:1786100612.261289:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100612.261628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100612.261769:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941826304 00000100:00100000:3.0:1786100612.261798:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941826304 00010000:00010000:3.0:1786100612.261970:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3222 expref: 32 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100612.262300:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00100000:3.0:1786100612.262314:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47361850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+32:2351:x1872861941826304:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786100612.262334:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786100612.262342:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3222 expref: 32 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.262359:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3222 expref: 32 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.262385:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165e400/0x5564f2c20ac1be2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3222 expref: 32 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.262407:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:3.0:1786100612.262412:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac1cf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.262424:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac1cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.262432:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac1cf3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100612.262907:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786100612.263170:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47361850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a93440-3d3b-4616-8388-e39125c10990+31:2351:x1872861941826304:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 671us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100612.263197:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 85 00010000:00010000:2.0:1786100612.263330:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac1cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263340:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac1cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100612.263395:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1786100612.263400:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100612.263426:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac1cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263442:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac1cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263453:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263467:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1ce5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263474:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263481:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100612.263486:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263495:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1ce5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263507:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:2.0:1786100612.263510:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100612.263514:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1ce5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263520:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98800/0x5564f2c20ac1ce5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263533:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263539:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1cec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263555:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1cec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263560:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100612.263572:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1cec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263579:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1cec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263587:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a3c454ab300) 00010000:00010000:2.0:1786100612.263590:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100612.263593:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1cec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263600:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac1cec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263641:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99e00/0x5564f2c20ac1cde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3268 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263686:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac1cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3268 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100612.263694:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100612.263696:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100612.263699:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99600, rc 0) 00000100:00100000:2.0:1786100612.263739:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2a93440-3d3b-4616-8388-e39125c10990+30:11619:x1872861941825664:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 17623us (20232us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100612.263747:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 235 00000001:00080000:1.0:1786100612.598814:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1786100612.598842:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1786100612.748997:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100612.749035:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100612.749117:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100612.749151:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941826432 00000100:00100000:0.0:1786100612.749160:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941826432 00000100:00100000:0.0:1786100612.749222:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 296 00000100:00100000:0.0:1786100612.749232:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2353:x1872861941826432:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100612.749300:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+13:2353:x1872861941826432:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 69us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100612.749308:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 296 00000100:00100000:0.0:1786100612.749340:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941826688 00000100:00100000:0.0:1786100612.749344:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941826688 00000100:00100000:0.0:1786100612.749386:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 154 00000100:00100000:0.0:1786100612.749392:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941826688:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100612.749423:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3868b77e-5219-4134-824e-d85227fdc483+5:2353:x1872861941826688:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 31us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100612.749429:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 154 00000100:00100000:2.0:1786100612.750129:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941826560 00000100:00100000:2.0:1786100612.750135:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941826560 00000100:00100000:2.0:1786100612.750168:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 89 00000100:00100000:2.0:1786100612.750177:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941826560:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100612.750231:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2354:x1872861941826560:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 57us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100612.750239:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 89 00000100:00080000:3.0:1786100612.751796:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786100612.751803:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1786100613.075700:0:12527:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786100613.075710:0:12527:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786100613.075753:0:12527:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1786100613.075759:0:12527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786100613.259771:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100613.259922:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941826944 00000100:00100000:1.0:1786100613.259932:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941826944 00000100:00100000:1.0:1786100613.259992:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 236 00000100:00100000:1.0:1786100613.260003:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+30:11642:x1872861941826944:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100613.260025:0:9953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100613.260045:0:9953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1cfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c326f expref: -99 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100613.260136:0:9953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1d01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100613.260151:0:9953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1d01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100613.260164:0:9953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1d01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100613.260175:0:9953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1786100613.260292:0:9953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1cfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c326f expref: 33 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100613.260309:0:9953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1d01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c326f expref: 32 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100613.260333:0:9953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:1.0:1786100613.260336:0:9953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1786100613.260340:0:9953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165f800, rc 0) 00000100:00100000:1.0:1786100613.260954:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+32:11642:x1872861941826944:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 952us (1191us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1786100613.260963:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 236 00000100:00100000:2.0:1786100613.274696:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100613.276001:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941827072 00000100:00100000:0.0:1786100613.276013:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941827072 00000100:00100000:0.0:1786100613.276125:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 237 00000100:00100000:0.0:1786100613.276137:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e02aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+32:11642:x1872861941827072:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:0.0:1786100613.276204:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1d0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100613.276234:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100613.276246:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100613.276273:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100613.276280:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1d0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100613.276287:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100613.276293:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbae00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100613.276297:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100613.276304:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1d0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100613.276315:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:0.0:1786100613.276318:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786100613.276322:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1d0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100613.276328:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbae00/0x5564f2c20ac1d0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100613.276407:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e02aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+32:11642:x1872861941827072:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 272us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100613.276421:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 237 00010000:00010000:3.0:1786100613.284830:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100613.358759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100613.358943:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941827200 00000100:00100000:3.0:1786100613.358953:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941827200 00000100:00100000:3.0:1786100613.359007:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00100000:3.0:1786100613.359016:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+7:2354:x1872861941827200:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:3.0:1786100613.359033:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100613.359051:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e9d7db8/0x5564f2c20ac1d16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3276 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786100613.359075:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a75bb82, atime: 0x6a75bb82, ctime: 0x6a75bb82, blocks: 0xb 00010000:00010000:3.0:1786100613.359092:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=354s v=(0 0) 00010000:00010000:3.0:1786100613.359096:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100613.359104:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e9d7db8/0x5564f2c20ac1d16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3276 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100613.359120:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e9d7db8/0x5564f2c20ac1d16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3276 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100613.359132:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98e00, rc 0) 00000100:00100000:3.0:1786100613.359186:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:2354:x1872861941827200:12345-192.168.206.53@tcp:101:cat.0 Request processed in 171us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100613.359192:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 72 00000100:00100000:1.0:1786100613.365382:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100613.365481:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941827328 00000100:00100000:0.0:1786100613.365491:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941827328 00002000:00100000:0.0:1786100613.365538:0:6691:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9a3b439cdf80 x1872861941827328/t0(0) o3->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:144/0 lens 488/0 e 0 to 0 dl 1786100624 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786100613.365549:0:6691:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3b439cdf80 with x1872861941827328 ext(0->4095) 00002000:00010000:0.0:1786100613.365554:0:6691:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3b439cdf80 00000100:00100000:0.0:1786100613.365595:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:0.0:1786100613.365605:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941827328:12345-192.168.206.53@tcp:3:cat.0 00000100:00100000:0.0:1786100613.366004:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d2a93440-3d3b-4616-8388-e39125c10990+8:2352:x1872861941827328:12345-192.168.206.53@tcp:3:cat.0 Request processed in 398us (628us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786100613.366013:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00002000:00100000:0.0:1786100613.366021:0:6691:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9a3b439cdf80 x1872861941827328/t0(0) o3->d2a93440-3d3b-4616-8388-e39125c10990@192.168.206.53@tcp:144/0 lens 488/4536 e 0 to 0 dl 1786100624 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786100613.366028:0:6691:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3b439cdf80 with x1872861941827328 ext(0->4095) 00002000:00010000:0.0:1786100613.366032:0:6691:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3b439cdf80 00010000:00010000:3.0:1786100614.308875:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100615.338386:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100615.590136:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960682368:0@lo:400:kworker.0 00000100:00100000:1.0:1786100615.590201:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100615.590285:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960682368 00000100:00100000:1.0:1786100615.590292:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960682368 00000100:00100000:1.0:1786100615.590339:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1786100615.590349:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960682368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100615.590394:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960682368:12345-0@lo:400:kworker.0 Request processed in 47us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100615.590402:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1786100615.590421:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100615.590449:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960682368:0@lo:400:kworker.0 00000100:00100000:1.0:1786100615.590480:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786100615.590487:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960682496:0@lo:400:kworker.0 00000100:00100000:1.0:1786100615.590512:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100615.590537:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960682496 00000100:00100000:1.0:1786100615.590541:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960682496 00000100:00100000:1.0:1786100615.590570:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1786100615.590589:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960682496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100615.590623:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960682496:12345-0@lo:400:kworker.0 Request processed in 35us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100615.590629:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1786100615.590643:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786100615.590680:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1786100615.590685:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1786100615.590701:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a3c50d89180, transno 4294967307 00000004:00080000:1.0:1786100615.590708:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1786100615.590719:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a3c6e09f100, transno 4294967310 00000100:00100000:1.0:1786100615.590723:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960682496:0@lo:400:kworker.0 00000100:00100000:0.0:1786100615.590933:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960682112:0@lo:400:kworker.0 00000100:00100000:0.0:1786100615.590977:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100615.591004:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960682624:0@lo:400:kworker.0 00000100:00100000:0.0:1786100615.591028:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100615.592257:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786100615.592274:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b439cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960682240:0@lo:400:kworker.0 00000100:00100000:0.0:1786100615.592320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100615.592361:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960682752:0@lo:400:kworker.0 00000100:00100000:0.0:1786100615.592388:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100615.592423:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960682752 00000100:00100000:0.0:1786100615.592429:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960682752 00000100:00100000:0.0:1786100615.592474:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1786100615.592483:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1872861960682752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100615.592530:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1872861960682752:12345-0@lo:400:kworker.0 Request processed in 48us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100615.592536:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1786100615.592859:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960682112 00000100:00100000:0.0:1786100615.592864:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960682112 00000100:00100000:0.0:1786100615.592889:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1786100615.592895:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960682112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100615.592928:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960682112:12345-0@lo:400:kworker.0 Request processed in 33us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100615.592934:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1786100615.592959:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960682624 00000100:00100000:0.0:1786100615.592962:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960682624 00000100:00100000:0.0:1786100615.592989:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960682240 00000100:00100000:0.0:1786100615.592991:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960682240 00000100:00100000:0.0:1786100615.593007:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1786100615.593014:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960682624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100615.593045:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960682624:12345-0@lo:400:kworker.0 Request processed in 31us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100615.593050:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1786100615.593062:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1786100615.593068:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960682240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100615.593108:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960682240:12345-0@lo:400:kworker.0 Request processed in 40us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100615.593114:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:0.0:1786100615.593142:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786100615.593147:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786100615.593173:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960682240:0@lo:400:kworker.0 00000100:00100000:0.0:1786100615.593183:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960682752:0@lo:400:kworker.0 00000100:00100000:0.0:1786100615.593191:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960682112:0@lo:400:kworker.0 00000100:00100000:0.0:1786100615.593199:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b439cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960682624:0@lo:400:kworker.0 00000100:00100000:0.0:1786100616.104538:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c47369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960683008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100616.104605:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100616.104732:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786100616.104739:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960682880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100616.104762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100616.104868:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960683008 00000100:00100000:1.0:1786100616.104875:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960683008 00000100:00100000:1.0:1786100616.104920:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960682880 00000100:00100000:1.0:1786100616.104923:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960682880 00000100:00100000:1.0:1786100616.104939:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786100616.104947:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960683008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786100616.104980:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100616.105007:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786100616.105015:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1872861960682880:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100616.105025:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960683008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100616.105031:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00002000:00000024:0.0:1786100616.105032:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100616.105060:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1872861960682880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100616.105065:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786100616.105070:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c47369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960683008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100616.105095:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960682880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786100616.356867:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786100617.193714:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:0.0:1786100617.193733:0:5865:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a3c6ded5600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1786100617.193738:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c47ef0400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c6ded5900 00000020:00080000:0.0:1786100617.193741:0:5865:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a3c47ef0b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a3c4736d800 00000001:00080000:0.0:1786100617.193765:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1786100617.193776:0:5865:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1786100617.193950:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1786100617.194124:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1786100617.204046:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1786100617.204134:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000100:00100000:0.0:1786100617.311016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100617.312013:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941827456 00000100:00100000:2.0:1786100617.312023:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941827456 00000100:00100000:2.0:1786100617.312110:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 238 00000100:00100000:2.0:1786100617.312121:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+19:11304:x1872861941827456:12345-192.168.206.53@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1786100617.312199:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100617.312223:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2a93440-3d3b-4616-8388-e39125c10990+19:11304:x1872861941827456:12345-192.168.206.53@tcp:60:lhsmtool_posix.0 Request processed in 103us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100617.312231:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 238 00000100:00100000:1.0:1786100617.316258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100617.316337:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941827712 00000100:00100000:3.0:1786100617.316353:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941827712 00000100:00100000:1.0:1786100617.316571:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 65 00000100:00100000:1.0:1786100617.316589:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+19:11304:x1872861941827712:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786100617.317357:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+20:11304:x1872861941827712:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 767us (1100us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1786100617.317378:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 65 00010000:00010000:3.0:1786100617.381124:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100617.526531:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100617.529384:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941827840 00000100:00100000:1.0:1786100617.529399:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941827840 00000100:00100000:1.0:1786100617.529559:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 239 00000100:00100000:1.0:1786100617.529570:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+5:12094:x1872861941827840:12345-192.168.206.53@tcp:101:lsof.0 00010000:00010000:1.0:1786100617.529591:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100617.529671:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1d1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c327d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100617.529737:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1d24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100617.529750:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100617.529762:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100617.529966:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786100617.529971:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100617.530047:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100617.530071:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fc00/0x5564f2c20ac1d1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c327d expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100617.530087:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1d24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c327d expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100617.530101:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:1.0:1786100617.530104:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100617.530108:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165fa00, rc 0) 00000100:00100000:1.0:1786100617.530181:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3868b77e-5219-4134-824e-d85227fdc483+6:12094:x1872861941827840:12345-192.168.206.53@tcp:101:lsof.0 Request processed in 612us (3660us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100617.530189:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 239 00000100:00080000:0.0:1786100617.537066:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100617.864174:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100617.864227:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100617.864765:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100617.865039:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941828224 00000100:00100000:3.0:1786100617.865051:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941828224 00000100:00100000:3.0:1786100617.865124:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941828096 00000100:00100000:3.0:1786100617.865128:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941828096 00000100:00100000:3.0:1786100617.865154:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 92 00000100:00100000:3.0:1786100617.865167:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:2351:x1872861941828224:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100617.865261:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:2351:x1872861941828224:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 97us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100617.865269:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 92 00000100:00100000:3.0:1786100617.865290:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 93 00000100:00100000:3.0:1786100617.865298:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+5:2351:x1872861941828096:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100617.865325:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+5:2351:x1872861941828096:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 28us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100617.865332:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 93 00000100:00080000:0.0:1786100617.866338:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786100617.866348:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786100617.866459:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941827968 00000100:00100000:1.0:1786100617.866473:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941827968 00000100:00100000:1.0:1786100617.866542:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 298 00000100:00100000:1.0:1786100617.866553:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941827968:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100617.866637:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941827968:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 84us (2477us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100617.866647:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 298 00010000:00010000:0.0:1786100618.405321:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100619.428868:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100620.453761:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786100620.514894:0:12729:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 07:03:38 (1786100618) 00000100:00100000:3.0:1786100620.719388:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960683392:0@lo:400:kworker.0 00000100:00100000:2.0:1786100620.719539:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c459c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960683264:0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.719864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100620.719945:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786100620.719953:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960683520:0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.719990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100620.720022:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100620.720056:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960683776:0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.720079:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100620.720103:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786100620.720109:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c47369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960683136:0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.720134:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100620.720156:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960683648:0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.720177:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100620.720204:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960683520 00000100:00100000:3.0:1786100620.720210:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960683520 00000100:00100000:3.0:1786100620.720261:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960683776 00000100:00100000:3.0:1786100620.720265:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960683776 00000100:00100000:3.0:1786100620.720287:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1786100620.720298:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960683520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.720345:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960683520:12345-0@lo:400:kworker.0 Request processed in 50us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100620.720352:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1786100620.720366:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1786100620.720373:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960683776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.720406:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960683776:12345-0@lo:400:kworker.0 Request processed in 33us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100620.720411:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1786100620.720427:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960683392 00000100:00100000:3.0:1786100620.720431:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960683392 00000100:00100000:3.0:1786100620.720471:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960683264 00000100:00100000:3.0:1786100620.720475:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960683264 00000100:00100000:3.0:1786100620.720495:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960683648 00000100:00100000:3.0:1786100620.720497:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960683648 00000100:00100000:3.0:1786100620.720511:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1786100620.720517:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960683392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.720549:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960683392:12345-0@lo:400:kworker.0 Request processed in 32us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100620.720554:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1786100620.720564:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1786100620.720569:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960683264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.720594:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960683264:12345-0@lo:400:kworker.0 Request processed in 24us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100620.720599:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1786100620.720609:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1786100620.720614:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960683648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.720636:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960683648:12345-0@lo:400:kworker.0 Request processed in 23us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100620.720642:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1786100620.720686:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786100620.720690:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786100620.720692:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786100620.720719:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960683520:0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.720728:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960683392:0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.720753:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960683648:0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.720761:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c459c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960683264:0@lo:400:kworker.0 00000100:00100000:3.0:1786100620.720769:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1786100620.720778:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a3c50d8b480, transno 4294967322 00000004:00080000:3.0:1786100620.720789:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1786100620.720818:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960683776:0@lo:400:kworker.0 00000100:00100000:2.0:1786100620.721172:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960683136 00000100:00100000:2.0:1786100620.721177:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960683136 00000100:00100000:2.0:1786100620.721204:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1786100620.721210:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960683136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100620.721254:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960683136:12345-0@lo:400:kworker.0 Request processed in 44us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100620.721261:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1786100620.724047:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c47369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960683136:0@lo:400:kworker.0 00000100:00100000:0.0:1786100621.221002:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786100621.225025:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786100621.225062:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c47369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960684032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786100621.225144:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100621.225256:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960684032 00000100:00100000:0.0:1786100621.225265:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960684032 00000100:00100000:0.0:1786100621.225323:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786100621.225333:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960684032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786100621.225365:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100621.225422:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960684032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100621.225430:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1786100621.225520:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c47369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960684032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100621.226784:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960683904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100621.226853:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100621.229569:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960683904 00000100:00100000:2.0:1786100621.229582:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960683904 00000100:00100000:2.0:1786100621.229662:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786100621.229673:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960683904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786100621.229711:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100621.229803:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960683904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100621.229811:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1786100621.229960:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960683904:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786100621.480689:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786100621.483010:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786100621.483020:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786100621.483297:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1786100621.483305:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:00080000:3.0:1786100622.332969:0:5865:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1786100622.332994:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1786100622.333006:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1786100622.333014:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1786100622.501063:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100622.989520:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100622.989561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100622.989597:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100622.989645:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100622.989699:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100622.989722:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941828864 00000100:00100000:0.0:1786100622.989730:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941828864 00000100:00100000:0.0:1786100622.989776:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941828480 00000100:00100000:0.0:1786100622.989779:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941828480 00000100:00100000:0.0:1786100622.989818:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 161 00000100:00100000:0.0:1786100622.989828:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+6:2352:x1872861941828864:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100622.989888:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+6:2352:x1872861941828864:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 62us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100622.989895:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 161 00000100:00100000:0.0:1786100622.989910:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 162 00000100:00100000:0.0:1786100622.989916:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+19:2352:x1872861941828480:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100622.989943:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+19:2352:x1872861941828480:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 27us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100622.989949:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 162 00000100:00100000:0.0:1786100622.989968:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941828608 00000100:00100000:0.0:1786100622.989972:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941828608 00000100:00100000:2.0:1786100622.989989:0:9414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941828736 00000100:00100000:2.0:1786100622.989996:0:9414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941828736 00000100:00100000:0.0:1786100622.990004:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 96 00000100:00100000:0.0:1786100622.990012:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2352:x1872861941828608:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100622.990040:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2352:x1872861941828608:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 28us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100622.990049:0:9414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 97 00000100:00100000:2.0:1786100622.990059:0:9414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941828736:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100622.990093:0:9414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2a93440-3d3b-4616-8388-e39125c10990+7:2352:x1872861941828736:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 36us (394us total) trans 0 rc 0/0 00000100:00080000:3.0:1786100622.990176:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786100622.990180:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786100622.990183:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100622.990500:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941828352 00000100:00100000:1.0:1786100622.990505:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941828352 00000100:00100000:1.0:1786100622.990537:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 300 00000100:00100000:1.0:1786100622.990544:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2352:x1872861941828352:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:1.0:1786100622.990639:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d69173c-d092-48de-a520-1459f9171aec+13:2352:x1872861941828352:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 94us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100622.990675:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 300 00000100:00100000:0.0:1786100622.998092:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 96 00000100:00100000:2.0:1786100622.998110:0:9414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 97 00010000:00010000:3.0:1786100623.524813:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100624.281321:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100624.281587:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941829120 00000100:00100000:2.0:1786100624.281597:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941829120 00000100:00100000:2.0:1786100624.281690:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00100000:2.0:1786100624.281701:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+19:12315:x1872861941829120:12345-192.168.206.53@tcp:35:umount.0 00000100:00100000:2.0:1786100624.282512:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2a93440-3d3b-4616-8388-e39125c10990+20:12315:x1872861941829120:12345-192.168.206.53@tcp:35:umount.0 Request processed in 811us (1198us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1786100624.282521:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 66 00000100:00080000:3.0:1786100624.283950:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100624.298012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100624.298137:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941829376 00000100:00100000:0.0:1786100624.298147:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941829376 00000100:00100000:0.0:1786100624.298203:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 67 00000100:00100000:0.0:1786100624.298232:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+20:12315:x1872861941829376:12345-192.168.206.53@tcp:35:umount.0 00000100:00100000:0.0:1786100624.298575:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+21:12315:x1872861941829376:12345-192.168.206.53@tcp:35:umount.0 Request processed in 350us (571us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1786100624.298583:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 67 00000100:00100000:0.0:1786100624.305119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100624.305194:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941829632 00000100:00100000:3.0:1786100624.305205:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941829632 00000100:00100000:3.0:1786100624.305253:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 68 00000100:00100000:3.0:1786100624.305264:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6af03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+21:12315:x1872861941829632:12345-192.168.206.53@tcp:35:umount.0 00000100:00100000:3.0:1786100624.305729:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6af03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+22:12315:x1872861941829632:12345-192.168.206.53@tcp:35:umount.0 Request processed in 465us (618us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1786100624.305738:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 68 00000100:00100000:3.0:1786100624.311175:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100624.311311:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941829888 00000100:00100000:0.0:1786100624.311321:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941829888 00000100:00100000:0.0:1786100624.311372:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:0.0:1786100624.311382:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+22:12315:x1872861941829888:12345-192.168.206.53@tcp:35:umount.0 00000100:00100000:0.0:1786100624.311723:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2a93440-3d3b-4616-8388-e39125c10990+23:12315:x1872861941829888:12345-192.168.206.53@tcp:35:umount.0 Request processed in 341us (555us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1786100624.311731:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 69 00000100:00100000:1.0:1786100624.317958:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100624.318006:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100624.318035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100624.318074:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100624.318111:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941830400 00000100:00100000:1.0:1786100624.318120:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941830400 00000100:00100000:1.0:1786100624.318172:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941830656 00000100:00100000:1.0:1786100624.318175:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941830656 00000100:00100000:1.0:1786100624.318188:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941830528 00000100:00100000:1.0:1786100624.318191:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941830528 00000100:00100000:1.0:1786100624.318205:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:1.0:1786100624.318214:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74860a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d69173c-d092-48de-a520-1459f9171aec+15:2351:x1872861941830400:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100624.318228:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100624.318246:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbba200/0x5564f2c20ac0d9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e08 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100624.318264:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100624.318309:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74860a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d69173c-d092-48de-a520-1459f9171aec+14:2351:x1872861941830400:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 97us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100624.318316:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:1.0:1786100624.318331:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:1.0:1786100624.318337:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d69173c-d092-48de-a520-1459f9171aec+13:2351:x1872861941830656:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100624.318344:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100624.318353:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0b200/0x5564f2c20ac0f86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ed3 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100624.318374:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100624.318391:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d69173c-d092-48de-a520-1459f9171aec+12:2351:x1872861941830656:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 54us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100624.318398:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:1.0:1786100624.318409:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:1.0:1786100624.318415:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74860000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d69173c-d092-48de-a520-1459f9171aec+11:2351:x1872861941830528:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100624.318422:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100624.318430:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac0d02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2dd0 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100624.318437:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100624.318454:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74860000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d69173c-d092-48de-a520-1459f9171aec+10:2351:x1872861941830528:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 39us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100624.318460:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:3.0:1786100624.318689:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941830272 00000100:00100000:3.0:1786100624.318694:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941830272 00000100:00100000:3.0:1786100624.318745:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 73 00000100:00100000:3.0:1786100624.318760:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c74862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+7:2350:x1872861941830272:12345-192.168.206.53@tcp:9:umount.0 00000020:00000080:3.0:1786100624.318797:0:6683:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac12dc 00000020:00010000:3.0:1786100624.318804:0:6683:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a3c45048000: total 0 00000100:00080000:3.0:1786100624.318808:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9a3c4504c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786100624.318845:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1786100624.319066:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c74862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2a93440-3d3b-4616-8388-e39125c10990+5:2350:x1872861941830272:12345-192.168.206.53@tcp:9:umount.0 Request processed in 306us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100624.319073:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 73 00000020:00010000:3.0:1786100624.319091:0:5830:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a3c45048000: total 0 00010000:00010000:3.0:1786100624.319110:0:5830:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a3c45048000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1786100624.319151:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e9d7db8/0x5564f2c20ac1d16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3276 expref: 4 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100624.319178:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026774584/0x5564f2c20ac1678 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30a8 expref: 3 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100624.319194:0:5830:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a3c45048000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1786100624.319204:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100624.319206:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100624.319208:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786100624.319479:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786100624.340083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100624.340257:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941830784 00000100:00100000:0.0:1786100624.340266:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941830784 00000100:00100000:0.0:1786100624.340386:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 74 00000100:00100000:0.0:1786100624.340396:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+5:2350:x1872861941830784:12345-192.168.206.53@tcp:9:umount.0 00000020:00000080:0.0:1786100624.340424:0:6684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac1074 00000100:00080000:0.0:1786100624.340431:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9a3b42760800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786100624.340474:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1786100624.340736:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2a93440-3d3b-4616-8388-e39125c10990+2:2350:x1872861941830784:12345-192.168.206.53@tcp:9:umount.0 Request processed in 340us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100624.340744:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 74 00010000:00010000:1.0:1786100624.341222:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786100624.342901:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786100624.357049:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100624.357175:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941831808 00000100:00100000:1.0:1786100624.357184:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941831808 00000100:00100000:1.0:1786100624.357242:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 240 00000100:00100000:1.0:1786100624.357252:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+23:2350:x1872861941831808:12345-192.168.206.53@tcp:39:umount.0 00000020:00000080:1.0:1786100624.357285:0:9953:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0d10 00000020:00010000:1.0:1786100624.357313:0:9953:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a3b41ed5000: total 0 00000100:00080000:1.0:1786100624.357317:0:9953:0:(import.c:65:import_set_state_nolock()) ffff9a3c45148800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786100624.357345:0:9953:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1786100624.357696:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2a93440-3d3b-4616-8388-e39125c10990+22:2350:x1872861941831808:12345-192.168.206.53@tcp:39:umount.0 Request processed in 445us (655us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1786100624.357719:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 240 00000020:00010000:2.0:1786100624.358254:0:8454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a3b41ed5000: total 0 00010000:00010000:2.0:1786100624.358315:0:8454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a3b41ed5000, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1786100624.358379:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100624.358383:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786100624.358392:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbc00/0x5564f2c20ac1cc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3261 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358408:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:2.0:1786100624.358411:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786100624.358415:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f200/0x5564f2c20ac16da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30c4 expref: 20 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358441:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df900) 00010000:00010000:2.0:1786100624.358444:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100624.358448:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb600/0x5564f2c20ac0ff6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ee8 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358465:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:2.0:1786100624.358468:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100624.358472:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98600/0x5564f2c20ac1639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3093 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358484:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:2.0:1786100624.358486:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786100624.358490:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac19d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c319d expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358501:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100624.358503:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1786100624.358506:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165f800/0x5564f2c20ac1d01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c326f expref: 16 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358525:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a3c433df100) 00010000:00010000:2.0:1786100624.358528:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786100624.358532:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbac00/0x5564f2c20ac0fda lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ee1 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358545:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:2.0:1786100624.358548:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1786100624.358551:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e600/0x5564f2c20ac1663 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30a1 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358563:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a3c454abf00) 00010000:00010000:2.0:1786100624.358565:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786100624.358569:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98200/0x5564f2c20ac16f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c30cb expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358582:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a3c454ab200) 00010000:00010000:2.0:1786100624.358584:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786100624.358587:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98a00/0x5564f2c20ac1559 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c305b expref: 12 pid: 9953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358600:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:2.0:1786100624.358602:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786100624.358606:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac104a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2efd expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358616:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100624.358619:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786100624.358627:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51f800/0x5564f2c20ac1bf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3229 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358641:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a3c58043200) 00010000:00010000:2.0:1786100624.358643:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100624.358646:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac1cf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3268 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358709:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:2.0:1786100624.358712:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786100624.358715:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98c00/0x5564f2c20ac1337 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2fcf expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100624.358727:0:8454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a3b41ed5000, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1786100624.358741:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100624.358743:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100624.358745:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100624.552591:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100625.572937:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100625.833041:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c74860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960684160:0@lo:400:kworker.0 00000100:00100000:2.0:1786100625.833110:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100625.833277:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960684160 00000100:00100000:0.0:1786100625.833286:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960684160 00000100:00100000:0.0:1786100625.833336:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1786100625.833345:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960684160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100625.833752:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960684288:0@lo:400:kworker.0 00000100:00100000:3.0:1786100625.833828:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100625.833868:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960684288 00000100:00100000:3.0:1786100625.833872:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960684288 00000100:00100000:3.0:1786100625.833909:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1786100625.833916:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c459c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960684288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100625.833955:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c459c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960684288:12345-0@lo:400:kworker.0 Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100625.833962:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1786100625.834001:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960684288:0@lo:400:kworker.0 00000100:00100000:2.0:1786100625.838437:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c74860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28d1ade7-51d1-4427-9c4d-d62141c5468b:3307:1872861960684160:0@lo:400:kworker.0 00000100:00100000:3.0:1786100625.841613:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960684416:0@lo:400:kworker.0 00000100:00100000:1.0:1786100625.841667:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960684544:0@lo:400:kworker.0 00000100:00100000:2.0:1786100625.841683:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960684672:0@lo:400:kworker.0 00000100:00100000:0.0:1786100625.845430:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3307:x1872861960684160:12345-0@lo:400:kworker.0 Request processed in 12076us (12310us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100625.845445:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1786100625.845542:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960684800:0@lo:400:kworker.0 00000100:00100000:0.0:1786100625.845630:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100625.845854:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960684800 00000100:00100000:0.0:1786100625.845862:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960684800 00000100:00100000:0.0:1786100625.845920:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1786100625.845930:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b439cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960684800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100625.845986:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b439cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960684800:12345-0@lo:400:kworker.0 Request processed in 57us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100625.845991:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1786100625.846027:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960684800:0@lo:400:kworker.0 00000100:00080000:0.0:1786100625.846065:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786100625.846158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100625.846294:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960684416 00000100:00100000:0.0:1786100625.846299:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960684416 00000100:00100000:0.0:1786100625.846340:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1786100625.846347:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960684416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100625.846385:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960684416:12345-0@lo:400:kworker.0 Request processed in 39us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100625.846391:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1786100625.846609:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100625.846747:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960684544 00000100:00100000:0.0:1786100625.846752:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960684544 00000100:00100000:0.0:1786100625.846798:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1786100625.846806:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960684544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100625.846844:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960684544:12345-0@lo:400:kworker.0 Request processed in 39us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100625.846863:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1786100625.846949:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960684544:0@lo:400:kworker.0 00000100:00080000:3.0:1786100625.849884:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786100625.849895:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100625.849943:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960684416:0@lo:400:kworker.0 00000100:00100000:2.0:1786100625.851452:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100625.851617:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960684672 00000100:00100000:3.0:1786100625.851625:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960684672 00000100:00100000:3.0:1786100625.851711:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1786100625.851720:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960684672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100625.851796:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872861960684672:12345-0@lo:400:kworker.0 Request processed in 77us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100625.851802:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1786100625.851930:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960684672:0@lo:400:kworker.0 00000100:00080000:0.0:1786100625.852878:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100626.340933:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960684928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100626.341007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100626.341143:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960684928 00000100:00100000:1.0:1786100626.341150:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960684928 00000100:00100000:2.0:1786100626.341205:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960685056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100626.341213:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1786100626.341224:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960684928:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786100626.341241:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1786100626.341259:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100626.341320:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960684928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100626.341327:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1786100626.341340:0:9757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960685056 00000100:00100000:1.0:1786100626.341343:0:9757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960685056 00000100:00100000:1.0:1786100626.341360:0:9757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1786100626.341366:0:9757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960685056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786100626.341383:0:9757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100626.341487:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960684928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100626.344961:0:9757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960685056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3584us (3709us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100626.344977:0:9757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1786100626.347901:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960685056:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786100626.601297:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100626.605460:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100626.605498:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100626.605530:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100626.605612:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941831936 00000100:00100000:2.0:1786100626.605621:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941831936 00000100:00100000:2.0:1786100626.605698:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941832192 00000100:00100000:2.0:1786100626.605701:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941832192 00000100:00100000:0.0:1786100626.605703:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941832064 00000100:00100000:0.0:1786100626.605706:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941832064 00000100:00100000:2.0:1786100626.605718:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:2.0:1786100626.605772:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d69173c-d092-48de-a520-1459f9171aec+12:2352:x1872861941831936:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100626.605787:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100626.605806:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac0de2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e1d expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100626.605820:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100626.605866:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d69173c-d092-48de-a520-1459f9171aec+11:2352:x1872861941831936:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 140us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100626.616087:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:0.0:1786100626.616110:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d69173c-d092-48de-a520-1459f9171aec+11:2352:x1872861941832192:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100626.616129:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100626.616151:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbbb000/0x5564f2c20ac0f7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2ecc expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100626.616167:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100626.616226:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d69173c-d092-48de-a520-1459f9171aec+10:2352:x1872861941832192:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 127us (10727us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100626.616233:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:0.0:1786100626.616252:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:0.0:1786100626.616258:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d69173c-d092-48de-a520-1459f9171aec+9:2352:x1872861941832064:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100626.616265:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100626.616273:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac0de9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e47 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100626.616281:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100626.616296:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d69173c-d092-48de-a520-1459f9171aec+8:2352:x1872861941832064:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 38us (10766us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100626.616313:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:2.0:1786100626.622814:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:0.0:1786100626.623168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100626.623240:0:9953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941832448 00000100:00100000:1.0:1786100626.623260:0:9953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941832448 00000100:00100000:1.0:1786100626.623322:0:9953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 241 00000100:00100000:1.0:1786100626.623333:0:9953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+6:2350:x1872861941832448:12345-192.168.206.53@tcp:39:umount.0 00000020:00000080:1.0:1786100626.623407:0:9953:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0df7 00000020:00010000:1.0:1786100626.623426:0:9953:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a3c4504d000: total 0 00000100:00080000:1.0:1786100626.623430:0:9953:0:(import.c:65:import_set_state_nolock()) ffff9a3b41ed4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786100626.623459:0:9953:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1786100626.623693:0:9953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3868b77e-5219-4134-824e-d85227fdc483+5:2350:x1872861941832448:12345-192.168.206.53@tcp:39:umount.0 Request processed in 362us (525us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1786100626.623701:0:9953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 241 00000020:00010000:2.0:1786100626.623944:0:5830:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a3c4504d000: total 0 00010000:00010000:2.0:1786100626.623948:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100626.623981:0:5830:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a3c4504d000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1786100626.624009:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c461b1600) 00010000:00010000:2.0:1786100626.624012:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786100626.624020:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4165fa00/0x5564f2c20ac1d24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c327d expref: 4 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100626.624039:0:5830:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a3c4504d000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1786100626.624047:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100626.624049:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100626.624051:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786100626.624110:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100626.666143:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100626.666224:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941832704 00000100:00100000:3.0:1786100626.666233:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941832704 00000100:00100000:3.0:1786100626.666291:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 302 00000100:00100000:3.0:1786100626.666302:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+7:2350:x1872861941832704:12345-192.168.206.53@tcp:251:umount.0 00000020:00000080:3.0:1786100626.666341:0:5837:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0ced 00000020:00010000:3.0:1786100626.666348:0:5837:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a3c7bf12800: total 0 00000100:00080000:3.0:1786100626.666352:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9a3c7bf10800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1786100626.666419:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d69173c-d092-48de-a520-1459f9171aec+3:2350:x1872861941832704:12345-192.168.206.53@tcp:251:umount.0 Request processed in 119us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100626.666438:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 302 00000020:00010000:2.0:1786100626.666897:0:5831:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a3c7bf12800: total 0 00010000:00010000:2.0:1786100626.666942:0:5831:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a3c7bf12800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1786100626.666974:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62386c00/0x5564f2c20ac0da3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c2e0f expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100626.666986:0:5831:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a3c7bf12800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1786100626.666995:0:5831:0:(genops.c:906:class_export_put()) final put ffff9a3c7bf12800/9d69173c-d092-48de-a520-1459f9171aec 00010000:00010000:2.0:1786100626.667011:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100626.667013:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100626.667015:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786100626.667054:0:467:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7bf12800/9d69173c-d092-48de-a520-1459f9171aec for MGS 00000020:00000080:1.0:1786100626.667090:0:467:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c7bf10800 for MGS 00000001:00080000:3.0:1786100627.444490:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:3.0:1786100627.444511:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3868b77e-5219-4134-824e-d85227fdc483 00000001:00080000:3.0:1786100627.444516:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1786100627.444519:0:5865:0:(genops.c:906:class_export_put()) final put ffff9a3c4504d000/3868b77e-5219-4134-824e-d85227fdc483 00000001:00100000:3.0:1786100627.444534:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d2a93440-3d3b-4616-8388-e39125c10990 00000001:00080000:3.0:1786100627.444539:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1786100627.444547:0:5865:0:(genops.c:906:class_export_put()) final put ffff9a3b41ed5000/d2a93440-3d3b-4616-8388-e39125c10990 00000020:00000080:0.0:1786100627.447755:0:467:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c4504d000/3868b77e-5219-4134-824e-d85227fdc483 for lustre-MDT0000 00000001:00100000:1.0:1786100627.448064:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2a93440-3d3b-4616-8388-e39125c10990 00000020:00000080:1.0:1786100627.448070:0:7635:0:(genops.c:906:class_export_put()) final put ffff9a3c45048000/d2a93440-3d3b-4616-8388-e39125c10990 00000020:00000080:0.0:1786100627.449168:0:467:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3b41ed5000/d2a93440-3d3b-4616-8388-e39125c10990 for lustre-MDT0000 00000020:00000080:0.0:1786100627.449220:0:467:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3b41ed4800 for lustre-MDT0000 00000020:00000080:0.0:1786100627.449225:0:467:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c45148800 for lustre-MDT0000 00000020:00000080:0.0:1786100627.456527:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c45048000/d2a93440-3d3b-4616-8388-e39125c10990 for lustre-OST0001 00000020:00000080:0.0:1786100627.456576:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c4504c000 for lustre-OST0001 00010000:00010000:3.0:1786100627.620884:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786100627.992485:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d2a93440-3d3b-4616-8388-e39125c10990 00000020:00000080:2.0:1786100627.992494:0:6708:0:(genops.c:906:class_export_put()) final put ffff9a3b42767000/d2a93440-3d3b-4616-8388-e39125c10990 00000020:00000080:2.0:1786100627.992519:0:467:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3b42767000/d2a93440-3d3b-4616-8388-e39125c10990 for lustre-OST0000 00000020:00000080:2.0:1786100627.992556:0:467:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3b42760800 for lustre-OST0000 00000020:01000004:3.0:1786100628.517862:0:12930:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1786100628.524834:0:12930:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1786100628.524896:0:12930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.524909:0:12930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.524916:0:12930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.524924:0:12930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.524948:0:12930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1786100628.524953:0:12930:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1786100628.524973:0:12930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786100628.524978:0:12930:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1786100628.524983:0:12930:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1786100628.525007:0:12930:0:(import.c:65:import_set_state_nolock()) ffff9a3c74f02800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1786100628.525909:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1872861960685184:0@lo:39:umount.0 00000100:00100000:3.0:1786100628.525998:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786100628.526062:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100628.526069:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.526078:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba600 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:3.0:1786100628.526082:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.526091:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786100628.526097:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100628.526103:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786100628.526106:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1786100628.526108:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1786100628.526550:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.526559:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786100628.526600:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.526608:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba600/0x5564f2c20ac0d72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.526622:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100628.526623:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100628.526635:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100628.526668:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960685184 00000100:00100000:3.0:1786100628.526675:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960685184 00000100:00100000:3.0:1786100628.526722:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1786100628.526731:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1872861960685184:12345-0@lo:39:umount.0 00000020:00000080:3.0:1786100628.526947:0:5844:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0afc 00000100:00080000:3.0:1786100628.526956:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9a3c7cea7000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1786100628.527026:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1872861960685184:12345-0@lo:39:umount.0 Request processed in 295us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100628.527033:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1786100628.527042:0:5844:0:(genops.c:906:class_export_put()) final put ffff9a3c7cea0000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1786100628.527086:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c74f02800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1786100628.527098:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1872861960685184:0@lo:39:umount.0 00000100:00100000:1.0:1786100628.527768:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786100628.527783:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960685312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786100628.527826:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100628.527871:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960685312 00000100:00100000:1.0:1786100628.527877:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960685312 00000100:00100000:1.0:1786100628.527931:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786100628.527939:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c47362050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960685312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786100628.527950:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100628.527969:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0ba00/0x5564f2c20ac0d79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0d72 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100628.527983:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100628.528013:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c47362050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:3308:x1872861960685312:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100628.528032:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786100628.528092:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960685312:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1786100628.528141:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7cea0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1786100628.528185:0:12399:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c7cea7000 for lustre-MDT0000 00010000:00010000:1.0:1786100628.528203:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786100628.528281:0:12930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786100628.528286:0:12930:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1786100628.528292:0:12930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1786100628.529146:0:12930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529158:0:12930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529166:0:12930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529172:0:12930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529195:0:12930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786100628.529212:0:12930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529219:0:12930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529225:0:12930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529231:0:12930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529247:0:12930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1786100628.529259:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786100628.529265:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529272:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0a000 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:3.0:1786100628.529275:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529283:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786100628.529290:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100628.529295:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786100628.529298:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1786100628.529325:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529339:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786100628.529366:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529373:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0a000/0x5564f2c20ac0d80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0d87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529386:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100628.529389:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529395:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0ac00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:3.0:1786100628.529398:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529404:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786100628.529410:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100628.529414:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1786100628.529417:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1786100628.529419:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1786100628.529430:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529436:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786100628.529451:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529466:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0ac00/0x5564f2c20ac0ca7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0cae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529478:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100628.529480:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100628.529481:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100628.529492:0:12930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529499:0:12930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529505:0:12930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529511:0:12930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529521:0:12930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786100628.529526:0:12930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62387a00/0x5564f2c20ac0a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529532:0:12930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62387a00/0x5564f2c20ac0a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529538:0:12930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62387a00/0x5564f2c20ac0a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529545:0:12930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffff9a3c62387a00/0x5564f2c20ac0a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529559:0:12930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1786100628.529562:0:12930:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1786100628.529565:0:12930:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1786100628.529585:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786100628.529588:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529594:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386a00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:3.0:1786100628.529597:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529604:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786100628.529610:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100628.529615:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1786100628.529617:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1786100628.529619:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1786100628.529632:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529638:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786100628.529644:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529670:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c62386a00/0x5564f2c20ac0fa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0fb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529690:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100628.529694:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c62387a00/0x5564f2c20ac0a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529699:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387a00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:3.0:1786100628.529702:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62387a00/0x5564f2c20ac0a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529707:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c62387a00/0x5564f2c20ac0a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786100628.529713:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c62387a00/0x5564f2c20ac0a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100628.529718:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1786100628.529720:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1786100628.529722:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1786100628.529734:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c62387a00/0x5564f2c20ac0a5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529739:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786100628.529745:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c62387a00/0x5564f2c20ac0a5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529751:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c62387a00/0x5564f2c20ac0a5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0a62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100628.529774:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100628.529776:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100628.529782:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1786100628.529795:0:12930:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1786100628.529799:0:12930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1786100628.529803:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786100628.529808:0:12930:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1786100628.529815:0:12930:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a3c7bf10000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786100628.529820:0:12930:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a3c6f6ea000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786100628.529824:0:12930:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9a3c6e1999c0) has exports, disconnecting them 00000020:00080000:3.0:1786100628.529828:0:12930:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a3c7bf10000), last request at 1786100625 00000020:00000080:3.0:1786100628.529834:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0c6f 00000100:00080000:3.0:1786100628.529849:0:12930:0:(import.c:65:import_set_state_nolock()) ffff9a3c7bf13800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1786100628.529878:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1786100628.529889:0:12930:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a3c7bf10000): rc 0 00000020:00000080:3.0:1786100628.529891:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c7bf10000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1786100628.529899:0:12930:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a3c6f6ea000), last request at 1786100625 00000020:00000080:3.0:1786100628.529902:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0ba4 00000100:00080000:3.0:1786100628.529907:0:12930:0:(import.c:65:import_set_state_nolock()) ffff9a3c6f6ee000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1786100628.529917:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1786100628.529923:0:12930:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a3c6f6ea000): rc 0 00000020:00000080:3.0:1786100628.529925:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c6f6ea000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1786100628.529933:0:12930:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa94fc2b7fae0 00000100:00080000:3.0:1786100628.529949:0:12930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1786100628.529952:0:12930:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1786100628.529963:0:12930:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1786100628.530038:0:12930:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1786100628.530051:0:12930:0:(import.c:65:import_set_state_nolock()) ffff9a3c4504e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1786100628.530062:0:12930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1786100628.530064:0:12930:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1786100628.530071:0:12930:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786100628.530140:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960685952:0@lo:9:umount.0 00000100:00100000:3.0:1786100628.530196:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786100628.530241:0:12930:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1786100628.530250:0:12930:0:(import.c:65:import_set_state_nolock()) ffff9a3c4737d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1786100628.530267:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960686080:0@lo:9:umount.0 00000100:00100000:3.0:1786100628.530291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1786100628.530333:0:12930:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a3c6e1999c0) has no exports 00010000:00010000:1.0:1786100628.530612:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100628.530625:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960685440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786100628.530668:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100628.530690:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786100628.530696:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960685824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786100628.530716:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786100628.530741:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786100628.530749:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7bf10000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1786100628.530793:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c6f6ea000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1786100628.530814:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c7bf13800 for lustre-MDT0000 00000020:00000080:1.0:1786100628.530819:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c6f6ee000 for lustre-MDT0000 00000100:00100000:1.0:1786100628.530836:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960685440 00000100:00100000:1.0:1786100628.530842:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960685440 00000100:00100000:1.0:1786100628.530876:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960685824 00000100:00100000:1.0:1786100628.530878:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960685824 00000100:00100000:2.0:1786100628.530889:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960685696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786100628.530897:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786100628.530905:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960685440:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786100628.530916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786100628.530916:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100628.530931:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0ae00/0x5564f2c20ac0d87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0d80 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100628.530936:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786100628.530942:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960685568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786100628.530944:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100628.530959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100628.530978:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960685696 00000100:00100000:1.0:1786100628.530979:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+18:3308:x1872861960685440:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100628.530981:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960685696 00000100:00100000:1.0:1786100628.530987:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786100628.530998:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960685568 00000100:00100000:2.0:1786100628.531000:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960685568 00000100:00100000:1.0:1786100628.531002:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786100628.531008:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3308:x1872861960685824:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786100628.531011:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1786100628.531015:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1786100628.531016:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+19:3306:x1872861960685696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786100628.531021:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100628.531023:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4165f600/0x5564f2c20ac0a62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0a5b expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100628.531028:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62386800/0x5564f2c20ac0fb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0fa9 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100628.531035:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100628.531037:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100628.531057:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:3308:x1872861960685824:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100628.531062:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28d1ade7-51d1-4427-9c4d-d62141c5468b+17:3306:x1872861960685696:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100628.531063:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786100628.531068:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786100628.531074:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786100628.531080:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+15:3306:x1872861960685568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786100628.531086:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100628.531093:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62387200/0x5564f2c20ac0cae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0ca7 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100628.531096:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960685696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786100628.531103:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100628.531205:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28d1ade7-51d1-4427-9c4d-d62141c5468b+14:3306:x1872861960685568:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100628.531209:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28d1ade7-51d1-4427-9c4d-d62141c5468b:3306:1872861960685568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786100628.531212:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786100628.531240:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960685824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786100628.531247:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960685440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786100628.531284:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960685952 00000100:00100000:1.0:1786100628.531294:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960685952 00000100:00100000:1.0:1786100628.531325:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960686080 00000100:00100000:1.0:1786100628.531328:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960686080 00000100:00100000:1.0:1786100628.531345:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786100628.531351:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1872861960685952:12345-0@lo:9:umount.0 00000020:00000080:1.0:1786100628.531370:0:6683:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0bff 00000100:00080000:1.0:1786100628.531376:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9a3c7f862000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786100628.531404:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1786100628.531744:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3304:x1872861960685952:12345-0@lo:9:umount.0 Request processed in 392us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100628.531751:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786100628.531776:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786100628.531783:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1872861960686080:12345-0@lo:9:umount.0 00000020:00000080:1.0:1786100628.531794:0:6683:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0cd8 00000100:00080000:1.0:1786100628.531799:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9a3c4514d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786100628.531817:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1786100628.532010:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3304:x1872861960686080:12345-0@lo:9:umount.0 Request processed in 226us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100628.532015:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1786100628.532036:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786100628.532039:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786100628.532052:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100628.532056:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786100628.532077:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c4737d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1786100628.532088:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1786100628.532090:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786100628.532093:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960686080:0@lo:9:umount.0 00000100:00080000:1.0:1786100628.532104:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c4504e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1786100628.532112:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1786100628.532589:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786100628.532593:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960685952:0@lo:9:umount.0 00000020:00080000:3.0:1786100628.550179:0:12930:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a3c6e1999c0) has no exports 00000020:00000080:3.0:1786100628.658984:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0ab6 00000020:00000080:3.0:1786100628.658999:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c738c0000/lustre-QMT0000_UUID 00000020:01000000:3.0:1786100628.659069:0:12930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1786100628.659272:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786100628.659284:0:12930:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786100628.659288:0:12930:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9a3c44f319c0) has no exports 00010000:00010000:2.0:1786100628.659579:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786100628.659964:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0aaf 00000020:00000080:0.0:1786100628.659971:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c7cea1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1786100628.660025:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c738c0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1786100628.660126:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7cea1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786100628.660266:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786100628.660274:0:12930:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1786100628.660277:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c745e9000/lustre-QMT0000_UUID 00000020:00000080:0.0:1786100628.660280:0:12930:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c745e9000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1786100628.660288:0:12930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1786100628.660402:0:12930:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a3c48985c60 - data ffff9a3c8174d438/ffff9a3b4299e000 00000020:01000000:0.0:1786100628.660636:0:12930:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a3c7b920840 - data ffff9a3c817e9af8/ffff9a3c4811cc00 00000001:00000004:1.0:1786100628.674462:0:12930:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:0.0:1786100628.728566:0:12930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1786100628.728574:0:12930:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1786100628.728597:0:12930:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786100628.728600:0:12930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1786100628.729273:0:7121:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1786100628.729279:0:7121:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1786100628.729289:0:7121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1786100628.731222:0:12930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1786100628.731229:0:12930:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1786100628.731261:0:12930:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786100628.731263:0:12930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1786100628.731556:0:7954:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1786100628.731561:0:7954:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1786100628.731570:0:7954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1786100628.770330:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0a7e 00000020:00000080:2.0:1786100628.770345:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c6e1b0000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786100628.771599:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0a93 00000020:00000080:2.0:1786100628.771608:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c6e1b5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1786100628.771614:0:12930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1786100628.771620:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786100628.771628:0:12930:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1786100628.771632:0:12930:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9a3c6e19b380) has no exports 00000020:00000080:3.0:1786100628.771852:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c6e1b0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1786100628.771877:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c6e1b5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1786100628.772243:0:12930:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1786100628.772252:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0cd1 00000020:00000080:2.0:1786100628.772258:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c45149800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1786100628.772271:0:12930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1786100628.772275:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786100628.772282:0:12930:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1786100628.772286:0:12930:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9a3c7f4f3380) has no exports 00000020:00000080:2.0:1786100628.772291:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0cca 00000020:00000080:2.0:1786100628.772295:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c4737c800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1786100628.772598:0:12930:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1786100628.772602:0:12930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1786100628.772606:0:12930:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1786100628.772611:0:12930:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786100628.772626:0:12930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786100628.772717:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c45149800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1786100628.772725:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c4737c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1786100628.772729:0:12399:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c4737d000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1786100628.772996:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786100628.773005:0:12930:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786100628.773008:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c7fa8e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786100628.773010:0:12930:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7fa8e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1786100628.773015:0:12930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786100628.773077:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0bea 00000020:00000080:2.0:1786100628.773083:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c7f860800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1786100628.773442:0:12930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1786100628.773447:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786100628.773452:0:12930:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1786100628.773456:0:12930:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9a3c7c0199c0) has no exports 00000020:00000080:2.0:1786100628.773461:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0be3 00000020:00000080:2.0:1786100628.773464:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c4504a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1786100628.773537:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7f860800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1786100628.773714:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c4504a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1786100628.774632:0:12930:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1786100628.774637:0:12930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1786100628.774641:0:12930:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1786100628.774646:0:12930:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786100628.774745:0:12930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786100628.774978:0:12399:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c4504e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1786100628.775036:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786100628.775045:0:12930:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786100628.775049:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c7f866000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786100628.775052:0:12930:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7f866000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1786100628.775060:0:12930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786100628.775248:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786100628.775253:0:12930:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786100628.775256:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c45940800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786100628.775259:0:12930:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c45940800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1786100628.775318:0:12930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786100628.775410:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0a9a 00000020:00000080:2.0:1786100628.775416:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c6e1b6800/lustre-MDD0000_UUID 00000020:01000000:2.0:1786100628.775471:0:12930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1786100628.775476:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786100628.775481:0:12930:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1786100628.775485:0:12930:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9a3c6e198000) has no exports 00000020:00000080:2.0:1786100628.775508:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786100628.775512:0:12930:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1786100628.775516:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0aa1 00000020:00000080:2.0:1786100628.775521:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c6e1b0800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1786100628.776114:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c6e1b6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1786100628.776120:0:12399:0:(genops.c:906:class_export_put()) final put ffff9a3c6e1b4800/lustre-MDD0000_UUID 00000020:00000080:3.0:1786100628.776122:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c6e1b4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1786100628.776127:0:12399:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1786100628.776463:0:12930:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a3c47abb000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1786100628.776468:0:12930:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a3c47abb000 3 00000020:01000004:2.0:1786100628.776472:0:12930:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a3c47abb000 from lustre-MDT0000 00000020:00000080:2.0:1786100628.776494:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786100628.776500:0:12930:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1786100628.776503:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c6e1b3800/lustre-MDT0000_UUID 00000020:00000080:2.0:1786100628.776505:0:12930:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c6e1b3800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1786100628.776512:0:12930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1786100628.776541:0:12930:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1786100628.776544:0:12930:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1786100628.776548:0:12930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1786100628.776551:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786100628.776554:0:12930:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1786100628.776560:0:12930:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9a3c60c8c800 28d1ade7-51d1-4427-9c4d-d62141c5468b 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1786100628.776565:0:12930:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9a3c45168000) has exports, disconnecting them 00000020:00080000:2.0:1786100628.776569:0:12930:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a3c60c8c800), last request at 1786100413 00000020:00000080:2.0:1786100628.776583:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0a3f 00000020:00010000:2.0:1786100628.776588:0:12930:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a3c60c8c800: total 1 00000100:00080000:2.0:1786100628.776592:0:12930:0:(import.c:65:import_set_state_nolock()) ffff9a3c60c8e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1786100628.776614:0:12930:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a3c60c8c800): rc 0 00000020:00080000:2.0:1786100628.776618:0:12930:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9a3c45168000) has no exports 00000100:00100000:2.0:1786100628.776705:0:5838:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a3c4845ae00:5838] 2 exiting: rc = 0 00000020:00010000:0.0:1786100628.776865:0:8454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a3c60c8c800: total 1 00010000:00010000:0.0:1786100628.776895:0:8454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a3c60c8c800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1786100628.776922:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c41511a00/0x5564f2c20ac0d41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0d3a expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100628.776938:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0b000/0x5564f2c20ac0d4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0d48 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100628.776948:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0aa00/0x5564f2c20ac0d5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0d56 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100628.776958:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62387400/0x5564f2c20ac0d6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0d64 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100628.776968:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbbb200/0x5564f2c20ac0f94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0f8d expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100628.776978:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa0a200/0x5564f2c20ac0fa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0f9b expref: 4 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100628.776990:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c41510000/0x5564f2c20ac0b57 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0b50 expref: 3 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100628.777001:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62386000/0x5564f2c20ac0d95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5564f2c20ac0d8e expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100628.777010:0:8454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a3c60c8c800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1786100628.777021:0:8454:0:(genops.c:906:class_export_put()) final put ffff9a3c60c8c800/28d1ade7-51d1-4427-9c4d-d62141c5468b 00010000:00010000:0.0:1786100628.777026:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100628.777028:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100628.777038:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100628.777062:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a3c60648a00:5835] 0 exiting: rc = 1 00000100:00100000:3.0:1786100628.777408:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a3c50c2da00:5837] 1 exiting: rc = 0 00000020:00000080:3.0:1786100628.777444:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c6e1b0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1786100628.777458:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c60c8c800/28d1ade7-51d1-4427-9c4d-d62141c5468b for MGS 00000020:00000080:3.0:1786100628.777491:0:12399:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c60c8e800 for MGS 00000100:00100000:2.0:1786100628.777558:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777566:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777578:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777584:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777590:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777595:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777601:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777606:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777612:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777617:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777622:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777630:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777635:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777640:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777645:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777674:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777681:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777686:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777691:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777698:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777703:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777709:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777714:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777722:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777727:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777733:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777739:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777745:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777750:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777824:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777970:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777976:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777982:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777987:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777993:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.777999:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778004:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778018:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778023:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778028:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778034:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778039:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778045:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778051:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778057:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778063:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778069:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778076:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778081:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778087:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778094:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778099:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778104:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778110:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778115:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778120:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778125:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778129:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778134:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778140:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778145:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778151:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778157:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.778162:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1786100628.779064:0:12930:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1786100628.779069:0:12930:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1786100628.781174:0:12930:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a3c5ed32b40 - data ffff9a3c7fef6510/ffff9a3c7f443400 00000020:01000000:2.0:1786100628.781364:0:12930:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a3c60632a80 - data ffff9a3c678096c0/ffff9a3c473e3000 00000020:00000080:2.0:1786100628.782108:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0a23 00000020:00000080:2.0:1786100628.782115:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c47abe000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1786100628.783126:0:12930:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a3c47abb000 from MGS, refs=2 00000020:01000004:2.0:1786100628.783145:0:12930:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a3c47abb000 2 00000020:01000004:2.0:1786100628.783148:0:12930:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a3c47abb000 from MGS 00000020:00000080:2.0:1786100628.783183:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786100628.783192:0:12930:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1786100628.783195:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c47abf000/MGS 00000020:00000080:2.0:1786100628.783198:0:12930:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c47abf000/MGS for MGS 00000020:01000000:2.0:1786100628.783206:0:12930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1786100628.784504:0:12930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1786100628.784513:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786100628.784521:0:12930:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1786100628.784529:0:12930:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a3c74f06800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1786100628.784536:0:12930:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9a3c472d8000) has exports, disconnecting them 00000020:00080000:2.0:1786100628.784540:0:12930:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a3c74f06800), last request at 1786100414 00000020:00000080:2.0:1786100628.784545:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0aee 00000020:00080000:2.0:1786100628.784565:0:12930:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a3c74f06800): rc 0 00000020:00000080:2.0:1786100628.784570:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c74f06800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1786100628.788233:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c47abe000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786100628.788799:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c74f06800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1786100628.789797:0:12930:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1786100628.789803:0:12930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786100628.789807:0:12930:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1786100628.789813:0:12930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1786100628.790115:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c74f02800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1786100628.790222:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786100628.790230:0:12930:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1786100628.790234:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c745a7000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1786100628.790238:0:12930:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c745a7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1786100628.790243:0:12930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1786100628.790313:0:12930:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a3c47abb000 1 00000020:00000080:2.0:1786100628.790318:0:12930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0a15 00000020:00000080:2.0:1786100628.790325:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c47ab8800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1786100628.790343:0:12930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1786100628.790348:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786100628.790352:0:12930:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1786100628.790366:0:12930:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9a3c472d99c0) has no exports 00000020:00000080:0.0:1786100628.790484:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c47ab8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786100628.804242:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786100628.804265:0:12930:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1786100628.804271:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c60368000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786100628.804275:0:12930:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c60368000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1786100628.804284:0:12930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1786100628.804421:0:12930:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a3c47abb800 00000020:01000000:0.0:1786100628.804443:0:12930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1786100628.804447:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786100628.804451:0:12930:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1786100628.804454:0:12930:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9a3c44f33380) has no exports 00000100:00100000:3.0:1786100628.805713:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a3c6ae0fe00:5845] 2 exiting: rc = 0 00000100:00100000:3.0:1786100628.805820:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a3c44f1c400:5844] 1 exiting: rc = 0 00000100:00100000:2.0:1786100628.818793:0:9953:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a3b42878400:9953] 3 exiting: rc = 0 00000100:00100000:1.0:1786100628.834034:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a3c6282c000:5843] 0 exiting: rc = 1 00000100:00100000:0.0:1786100628.834516:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834526:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834531:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834547:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834555:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834559:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834564:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834569:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834575:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834580:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834586:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834591:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834597:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834607:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834614:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834619:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834636:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834641:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834646:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834683:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834689:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834694:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834700:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834705:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834711:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834716:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834722:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834728:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834734:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834739:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834745:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834763:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834769:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834775:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834780:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834792:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834798:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834804:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834810:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834815:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834821:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834826:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834931:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834938:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834943:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834948:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834953:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834958:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834964:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834970:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834975:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834987:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834993:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.834999:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.835005:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.835011:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.835017:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.835023:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.835029:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.835034:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.835040:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.835046:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.835051:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.835063:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.840968:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a3c6282d800:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1786100628.841640:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a3c6ae0e400:5846] 0 exiting: rc = 1 00000100:00100000:3.0:1786100628.841796:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841805:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841812:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841817:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841823:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841837:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841845:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841850:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841857:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841862:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841868:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841874:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841880:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841885:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841890:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841895:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841900:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841905:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841911:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841916:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841922:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841927:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841932:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841937:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841942:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841946:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841952:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841956:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841962:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841967:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841985:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841990:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.841995:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842001:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842007:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842012:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842017:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842023:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842028:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842033:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842039:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842044:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842049:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842054:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842059:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842064:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842070:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842075:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842080:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842086:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842091:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842096:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842102:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842107:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842113:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842118:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842123:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842129:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842134:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842139:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842144:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842149:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842155:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.842160:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.842869:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a3c583d7400:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1786100628.843178:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a3c583d7800:5848] 0 exiting: rc = 1 00000100:00100000:3.0:1786100628.843271:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843288:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843295:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843302:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843308:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843313:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843321:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843326:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843333:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843339:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843357:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843364:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843369:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843375:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843381:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843388:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843393:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843399:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843405:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843411:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843416:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843422:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843442:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843449:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843454:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843460:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843466:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843471:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843477:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843482:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843487:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843492:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843498:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843503:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843519:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843526:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843538:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843544:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843550:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843555:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843560:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843566:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843574:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843579:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843584:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843590:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843611:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843617:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843622:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843628:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843632:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843638:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843643:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843679:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843687:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843693:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843699:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843705:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843725:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843732:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843738:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843744:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843750:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.843776:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.857308:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a3c583d7c00:5850] 0 exiting: rc = 1 00000100:00100000:3.0:1786100628.857962:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a3c583d6800:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1786100628.858072:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858081:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858086:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858091:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858097:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858101:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858107:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858111:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858116:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858121:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858126:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858131:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858136:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858141:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858146:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858152:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858156:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858161:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858166:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858172:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858177:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858198:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858203:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858208:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858213:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858218:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858223:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858228:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858232:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858237:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858242:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858247:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858262:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858267:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858272:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858277:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858282:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858287:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858293:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858298:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858303:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858308:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858312:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858317:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858321:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858326:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858331:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858335:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858340:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858345:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858349:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858354:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858359:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858363:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858367:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858372:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858387:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858391:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858396:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858401:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858405:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858410:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858415:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.858419:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.858989:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a3c583d1200:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1786100628.859098:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a3c583d1c00:5853] 1 exiting: rc = 0 00000100:00100000:0.0:1786100628.859628:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859635:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859640:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859645:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859680:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859685:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859691:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859695:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859701:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859706:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859711:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859716:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859721:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859725:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859730:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859735:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859740:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859744:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859943:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859953:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859958:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859962:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859968:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859973:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859978:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.859994:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860000:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860016:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860021:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860027:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860032:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860037:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860042:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860047:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860052:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860057:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860063:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860068:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860074:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860080:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860085:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860090:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860096:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860101:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860106:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860111:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860116:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860121:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860126:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860131:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860136:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860141:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860147:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860151:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860157:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860161:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860166:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860170:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860175:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860179:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860184:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860189:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860201:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.860206:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.864033:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a3c583d0400:5854] 0 exiting: rc = 1 00000100:00100000:2.0:1786100628.867101:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a3c583d1a00:5855] 1 exiting: rc = 0 00000100:00100000:3.0:1786100628.867325:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867333:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867339:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867344:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867366:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867371:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867377:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867382:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867388:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867393:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867399:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867404:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867409:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867414:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867419:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867424:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867428:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867433:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867438:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867442:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867448:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867453:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867458:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867463:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867468:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867473:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867478:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867484:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867489:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867494:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867499:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867505:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867510:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867516:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867521:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867527:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867532:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867538:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867543:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867554:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867559:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867564:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867569:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867575:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867580:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867585:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867591:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867595:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867601:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867606:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867611:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867615:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867619:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867624:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867629:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867634:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867639:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867644:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867675:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867682:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867687:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867691:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867696:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100628.867702:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100628.869082:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a3c583d0c00:5857] 1 exiting: rc = 0 00000100:00100000:3.0:1786100628.869401:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a3c583d0200:5856] 0 exiting: rc = 1 00000100:00100000:3.0:1786100628.869551:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a3c583d0e00:5858] 2 exiting: rc = 0 00000100:00100000:2.0:1786100628.870224:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870232:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870237:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870244:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870249:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870540:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870546:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870552:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870558:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870564:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870571:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870577:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870583:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870589:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870595:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870601:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870607:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870613:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870619:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870625:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870631:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870637:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870643:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870703:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870710:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870727:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870733:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870970:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870978:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870983:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870989:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.870994:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871000:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871005:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871010:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871016:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871022:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871028:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871033:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871039:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871044:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871049:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871055:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871060:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871065:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871069:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871075:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871080:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871085:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871091:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871097:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871116:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871122:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871128:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871133:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871139:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871145:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871150:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871156:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871162:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871174:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871180:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871187:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100628.871200:0:12930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1786100628.878135:0:12930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786100628.878150:0:12930:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1786100628.878155:0:12930:0:(genops.c:906:class_export_put()) final put ffff9a3c45947800/MDS_uuid 00000020:00000080:0.0:1786100628.878159:0:12930:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c45947800/MDS_uuid for MDS 00000020:01000000:0.0:1786100628.878165:0:12930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1786100628.878301:0:12930:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1786100629.668792:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100630.710051:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100630.949931:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1872861960686464:0@lo:400:kworker.0 00000100:00100000:3.0:1786100630.949964:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960686336:0@lo:400:kworker.0 00000400:00000100:0.0:1786100630.949982:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872861960686464 offset 0 length 224: 4 00000400:00000100:3.0:1786100630.949984:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872861960686336 offset 0 length 224: 4 00000100:00100000:1.0:1786100630.950850:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960686208:0@lo:400:kworker.0 00000400:00000100:0.0:1786100630.957955:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872861960686208 offset 0 length 224: 4 00010000:00010000:1.0:1786100631.718992:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1786100631.923019:0:13079:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1786100631.940243:0:13079:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1786100631.940286:0:13079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100631.940300:0:13079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100631.940307:0:13079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100631.940314:0:13079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100631.940338:0:13079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1786100631.940344:0:13079:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1786100631.940361:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786100631.940372:0:13079:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a3c50d88e00 x1872861960686336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100646 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100631.940392:0:13079:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1786100631.940398:0:13079:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1786100631.940421:0:13079:0:(import.c:65:import_set_state_nolock()) ffff9a3c7f867000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1786100631.940530:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100631.940537:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100631.940544:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c41510c00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:1.0:1786100631.940547:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100631.940554:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786100631.940560:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100631.940565:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1786100631.940568:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1786100631.940570:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1786100631.940594:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100631.940601:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786100631.940640:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100631.940672:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c41510c00/0x5564f2c20ac0d56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5564f2c20ac0d5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100631.940686:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100631.940687:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100631.940689:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100631.940702:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1872861960686592:0@lo:39:umount.0 00000400:00000100:1.0:1786100631.940762:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872861960686592 offset 0 length 224: 4 00000100:00100000:1.0:1786100631.940818:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786100631.940827:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960686720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786100631.940858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100631.940892:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960686720 00000100:00100000:1.0:1786100631.940899:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960686720 00000100:00100000:1.0:1786100631.940933:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786100631.940940:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1872861960686720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1786100631.940946:0:5828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786100631 with bad export cookie 384581869132057151 00000100:00100000:3.0:1786100631.943560:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960686336:0@lo:400:kworker.0 00000100:00100000:1.0:1786100631.951625:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1872861960686720:12345-0@lo:103:ldlm_bl.0 Request processed in 10676us (10759us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786100631.951639:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1786100631.952010:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1786100631.952015:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9a3c45942000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1786100631.952019:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.153@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1786100631.958394:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.153@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1786100631.958400:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1786100631.958408:0:3308:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a3c50d8b800 x1872861960686208/t0(0) o400->MGC192.168.206.153@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786100646 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100631.958423:0:3308:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a3c7c10c380 x1872861960686720/t0(0) o103->MGC192.168.206.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1786100647 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1786100631.958432:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1786100631.958434:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1786100631.958436:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1786100631.958439:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9a3c45942000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786100631.958443:0:3308:0:(import.c:510:import_select_connection()) MGC192.168.206.153@tcp: connect to NID 0@lo last attempt 154 00000100:00080000:0.0:1786100631.958452:0:3308:0:(import.c:624:import_select_connection()) MGC192.168.206.153@tcp: import ffff9a3c45942000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:0.0:1786100631.958484:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3c50d8ad80 x1872861960686848/t0(0) o250->MGC192.168.206.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786100631.958569:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28d1ade7-51d1-4427-9c4d-d62141c5468b:3304:1872861960686848:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1786100631.958615:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872861960686848 offset 0 length 520: 4 00000100:00100000:0.0:1786100631.958865:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960686208:0@lo:400:kworker.0 00000100:00100000:0.0:1786100631.958893:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28d1ade7-51d1-4427-9c4d-d62141c5468b:3308:1872861960686720:0@lo:103:ldlm_bl.0 00000001:00100000:1.0:1786100632.533375:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786100632.533383:0:7635:0:(genops.c:906:class_export_put()) final put ffff9a3c4514f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786100632.533449:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c4514f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1786100632.533573:0:12399:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c4514d800 for lustre-OST0001 00010000:00010000:1.0:1786100632.742013:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786100633.090539:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786100633.090548:0:6708:0:(genops.c:906:class_export_put()) final put ffff9a3c7f864800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786100633.090689:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7f864800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1786100633.090857:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c7f862000 for lustre-OST0000 00010000:00010000:1.0:1786100633.766077:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100634.788921:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100635.812888:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786100636.068821:0:12399:0:(pinger.c:229:ptlrpc_pinger_process_import()) 28d1ade7-51d1-4427-9c4d-d62141c5468b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786100636.068831:0:12399:0:(pinger.c:247:ptlrpc_pinger_process_import()) 28d1ade7-51d1-4427-9c4d-d62141c5468b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1786100636.068962:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786100636.068983:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960686976:0@lo:400:kworker.0 00000400:00000100:1.0:1786100636.069034:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872861960686976 offset 0 length 224: 4 00010000:00010000:1.0:1786100636.843484:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786100637.093757:0:12399:0:(pinger.c:229:ptlrpc_pinger_process_import()) 28d1ade7-51d1-4427-9c4d-d62141c5468b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786100637.093766:0:12399:0:(pinger.c:247:ptlrpc_pinger_process_import()) 28d1ade7-51d1-4427-9c4d-d62141c5468b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1786100637.093869:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786100637.093886:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1872861960687104:0@lo:400:kworker.0 00000400:00000100:2.0:1786100637.093936:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872861960687104 offset 0 length 224: 4 00010000:00010000:1.0:1786100637.860893:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100638.884833:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100639.909832:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100640.932879:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100641.188928:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786100631/real 1786100631] req@ffff9a3c50d8ad80 x1872861960686848/t0(0) o250->MGC192.168.206.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786100641 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100641.188958:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a3c50d8ad80 x1872861960686848/t0(0) o250->MGC192.168.206.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786100641 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100641.188970:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786100631/real 1786100631] req@ffff9a3c473d2680 x1872861960686592/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786100641 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100641.188982:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a3c473d2680 x1872861960686592/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786100641 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786100641.188999:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c45942000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786100641.189021:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1786100641.189025:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28d1ade7-51d1-4427-9c4d-d62141c5468b:3304:1872861960686848:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1786100641.189031:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c7f867000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1786100641.189046:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1872861960686592:0@lo:39:umount.0 00000100:00080000:0.0:1786100641.189379:0:12399:0:(pinger.c:229:ptlrpc_pinger_process_import()) 28d1ade7-51d1-4427-9c4d-d62141c5468b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786100641.189385:0:12399:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1786100641.189388:0:12399:0:(import.c:65:import_set_state_nolock()) ffff9a3c45942000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786100641.189393:0:12399:0:(import.c:510:import_select_connection()) MGC192.168.206.153@tcp: connect to NID 0@lo last attempt 373 00000100:00080000:0.0:1786100641.189397:0:12399:0:(import.c:589:import_select_connection()) MGC192.168.206.153@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1786100641.189403:0:12399:0:(import.c:624:import_select_connection()) MGC192.168.206.153@tcp: import ffff9a3c45942000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:0.0:1786100641.189432:0:12399:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3c50d88a80 x1872861960687232/t0(0) o250->MGC192.168.206.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786100641.189506:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786100641.189518:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960687360:0@lo:400:kworker.0 00000400:00000100:0.0:1786100641.189563:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872861960687360 offset 0 length 224: 4 00000100:00100000:1.0:1786100641.189668:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28d1ade7-51d1-4427-9c4d-d62141c5468b:3304:1872861960687232:0@lo:250:kworker.0 00000400:00000100:1.0:1786100641.189714:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872861960687232 offset 0 length 520: 4 00000100:00080000:2.0:1786100641.190159:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786100641.190164:0:13079:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1786100641.190168:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1786100641.192930:0:13079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100641.192947:0:13079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100641.192954:0:13079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100641.192962:0:13079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100641.192992:0:13079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786100641.193000:0:13079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100641.193006:0:13079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100641.193012:0:13079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100641.193018:0:13079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100641.193164:0:13079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1786100641.193170:0:13079:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1786100641.193196:0:13079:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1786100641.193200:0:13079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1786100641.193205:0:13079:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786100641.193210:0:13079:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1786100641.193215:0:13079:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9a3c44f30000) has no exports 00000020:00080000:2.0:1786100641.193237:0:13079:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9a3c44f30000) has no exports 00000020:01000000:2.0:1786100641.198049:0:13079:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a3c48985f60 - data ffff9a3c817411b0/ffff9a3c6f6dc000 00000020:01000000:3.0:1786100641.199921:0:13079:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a3c489097e0 - data ffff9a3c436b7bd0/ffff9a3c4500cc00 00010000:00010000:0.0:1786100641.200253:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786100641.200264:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100641.200276:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c41511600 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100641.200280:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100641.200308:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100641.200316:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100641.200321:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1786100641.200324:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1786100641.200327:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1786100641.200341:0:8454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a3c45942000 00010000:00010000:0.0:1786100641.200345:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100641.200350:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c41511600/0x5564f2c20ac0d64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5564f2c20ac0d6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100641.200361:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100641.200364:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100641.200369:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98400 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100641.200372:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100641.200378:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100641.200384:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100641.200398:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1786100641.200400:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1786100641.200402:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1786100641.200409:0:8454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a3c45942000 00010000:00010000:0.0:1786100641.200412:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100641.200418:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98400/0x5564f2c20ac0f9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5564f2c20ac0fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100641.200427:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100641.200428:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100641.200430:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100641.200605:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1786100641.214889:0:13079:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1786100641.252284:0:13079:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0b73 00000020:00000080:1.0:1786100641.252294:0:13079:0:(genops.c:906:class_export_put()) final put ffff9a3c7f5cb800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1786100641.252311:0:13079:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a3c6e163000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1786100641.252315:0:13079:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a3c6e163000 2 00000020:01000004:1.0:1786100641.252318:0:13079:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a3c6e163000 from lustre-OST0000 00000020:00000080:1.0:1786100641.252339:0:13079:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786100641.252349:0:13079:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1786100641.252351:0:13079:0:(genops.c:906:class_export_put()) final put ffff9a3c7f5ce800/lustre-OST0000_UUID 00000020:00000080:1.0:1786100641.252354:0:13079:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7f5ce800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1786100641.252359:0:13079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1786100641.252400:0:13079:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1786100641.252404:0:13079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1786100641.252504:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7f5cb800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1786100641.252919:0:13079:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786100641.252925:0:13079:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1786100641.252932:0:13079:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a3c7f865800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786100641.252937:0:13079:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9a3c472db380) has exports, disconnecting them 00000020:00080000:1.0:1786100641.252941:0:13079:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a3c7f865800), last request at 1786100429 00000020:00000080:1.0:1786100641.252945:0:13079:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0b9d 00000020:00080000:1.0:1786100641.252955:0:13079:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a3c7f865800): rc 0 00000020:00000080:1.0:1786100641.252960:0:13079:0:(genops.c:906:class_export_put()) final put ffff9a3c7f865800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1786100641.253164:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7f865800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1786100641.258908:0:13079:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1786100641.258917:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786100641.258921:0:13079:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1786100641.258928:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1786100641.258956:0:12399:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c7f867000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1786100641.259094:0:13079:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786100641.259103:0:13079:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1786100641.259107:0:13079:0:(genops.c:906:class_export_put()) final put ffff9a3c7f867800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1786100641.259110:0:13079:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7f867800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1786100641.259115:0:13079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1786100641.259177:0:13079:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a3c6e163000 1 00000020:00000080:0.0:1786100641.259182:0:13079:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0b2d 00000020:00000080:0.0:1786100641.259188:0:13079:0:(genops.c:906:class_export_put()) final put ffff9a3c6d70f000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1786100641.259206:0:13079:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1786100641.259214:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c6d70f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1786100641.259225:0:13079:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786100641.259230:0:13079:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1786100641.259234:0:13079:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9a3c6e19cd40) has no exports 00000020:00000080:2.0:1786100641.279740:0:13079:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786100641.279755:0:13079:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1786100641.279760:0:13079:0:(genops.c:906:class_export_put()) final put ffff9a3c6e160000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1786100641.279765:0:13079:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c6e160000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1786100641.279774:0:13079:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1786100641.279909:0:13079:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a3c6e163800 00000020:02000400:2.0:1786100641.279953:0:13079:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1786100641.956864:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100642.980823:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100644.006026:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1786100644.365373:0:13234:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1786100644.382099:0:13234:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1786100644.382531:0:13234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100644.382546:0:13234:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100644.382553:0:13234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100644.382561:0:13234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100644.382611:0:13234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1786100644.382617:0:13234:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1786100644.382636:0:13234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786100644.382647:0:13234:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a3c50d8bb80 x1872861960686464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100646 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100644.382699:0:13234:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a3c473d2300 x1872861960686976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100652 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100644.382721:0:13234:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a3c50d8b800 x1872861960687104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100653 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100644.382729:0:13234:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a3c50d88000 x1872861960687360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100657 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100644.382744:0:13234:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1786100644.382771:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1872861960686976:0@lo:400:kworker.0 00000100:00080000:2.0:1786100644.382798:0:13234:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1786100644.382830:0:13234:0:(import.c:65:import_set_state_nolock()) ffff9a3b411ec000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1786100644.382874:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960687360:0@lo:400:kworker.0 00010000:00010000:1.0:1786100644.383149:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100644.383157:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100644.383165:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0b600 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:1.0:1786100644.383168:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100644.383183:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786100644.383190:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100644.383196:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1786100644.383198:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1786100644.383200:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1786100644.383212:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a3c45942000 00010000:00010000:1.0:1786100644.383216:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100644.383223:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b600/0x5564f2c20ac0d3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5564f2c20ac0d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100644.383234:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100644.383236:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100644.383237:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100644.383252:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1872861960687488:0@lo:39:umount.0 00000100:00100000:0.0:1786100644.383352:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1872861960687104:0@lo:400:kworker.0 00000400:00000100:1.0:1786100644.383444:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872861960687488 offset 0 length 224: 4 00000100:00100000:0.0:1786100644.383533:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1872861960686464:0@lo:400:kworker.0 00010000:00010000:0.0:1786100645.028856:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100646.052971:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786100646.309133:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) 28d1ade7-51d1-4427-9c4d-d62141c5468b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786100646.309146:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) 28d1ade7-51d1-4427-9c4d-d62141c5468b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1786100647.080064:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100648.100917:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100649.125136:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100650.149198:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100651.173082:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786100651.428734:0:12399:0:(pinger.c:229:ptlrpc_pinger_process_import()) 28d1ade7-51d1-4427-9c4d-d62141c5468b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786100651.428747:0:12399:0:(pinger.c:247:ptlrpc_pinger_process_import()) 28d1ade7-51d1-4427-9c4d-d62141c5468b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1786100652.197081:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100653.222681:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100654.244873:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100654.628763:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786100644/real 1786100644] req@ffff9a3c473d2300 x1872861960687488/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786100654 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100654.628814:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a3c473d2300 x1872861960687488/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786100654 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786100654.628833:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3b411ec000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1786100654.628914:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1872861960687488:0@lo:39:umount.0 00000100:00080000:2.0:1786100654.629334:0:13234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786100654.629338:0:13234:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1786100654.629444:0:13234:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1786100654.631236:0:13234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100654.631252:0:13234:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100654.631259:0:13234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100654.631273:0:13234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100654.631382:0:13234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786100654.631392:0:13234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100654.631399:0:13234:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100654.631405:0:13234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100654.631412:0:13234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100654.634520:0:13234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1786100654.634533:0:13234:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1786100654.634563:0:13234:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1786100654.634567:0:13234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1786100654.634577:0:13234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786100654.634584:0:13234:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1786100654.634617:0:13234:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9a3c7fa50000) has no exports 00000020:00080000:2.0:1786100654.634645:0:13234:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9a3c7fa50000) has no exports 00010000:00010000:1.0:1786100654.634753:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786100654.640441:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100654.640455:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100654.640456:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100654.640467:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa0be00 already unused, calling callback (ffffffffc1cabc20) 00010000:00010000:1.0:1786100654.640467:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c41511c00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:3.0:1786100654.640472:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786100654.640472:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100654.640482:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100654.640482:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786100654.640491:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786100654.640491:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100654.640497:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1786100654.640497:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786100654.640500:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1786100654.640500:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1786100654.640503:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1786100654.640504:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1786100654.640520:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a3c45942000 00010000:00010000:1.0:1786100654.640520:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a3c45942000 00010000:00010000:3.0:1786100654.640525:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100654.640525:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100654.640532:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0be00/0x5564f2c20ac0f8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5564f2c20ac0f94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100654.640532:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c41511c00/0x5564f2c20ac0d48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5564f2c20ac0d4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100654.640551:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100654.640553:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100654.640555:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100654.640563:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100654.640564:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100654.640565:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1786100654.645088:0:13234:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a3c48985f00 - data ffff9a3c67be7000/ffff9a3c74905800 00000020:01000000:2.0:1786100654.645252:0:13234:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a3c48985420 - data ffff9a3c7fe0e798/ffff9a3c7bfbf800 00100000:10000000:2.0:1786100654.656093:0:13234:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1786100654.701826:0:13234:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0c3e 00000020:00000080:3.0:1786100654.701836:0:13234:0:(genops.c:906:class_export_put()) final put ffff9a3c6d709800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1786100654.701864:0:13234:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a3c7f9ee000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1786100654.701869:0:13234:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a3c7f9ee000 2 00000020:00000080:2.0:1786100654.701869:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c6d709800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:3.0:1786100654.701872:0:13234:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a3c7f9ee000 from lustre-OST0001 00000020:00000080:3.0:1786100654.701897:0:13234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786100654.701907:0:13234:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1786100654.701910:0:13234:0:(genops.c:906:class_export_put()) final put ffff9a3c7f5cb000/lustre-OST0001_UUID 00000020:00000080:3.0:1786100654.701912:0:13234:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7f5cb000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1786100654.701920:0:13234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1786100654.702054:0:13234:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 28d1ade7-51d1-4427-9c4d-d62141c5468b->MGS 00010000:00010000:3.0:1786100654.702076:0:13234:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac0b50 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5564f2c20ac0b57 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786100654.702088:0:13234:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac0b50 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5564f2c20ac0b57 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100654.702094:0:13234:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1786100654.702097:0:13234:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1786100654.702100:0:13234:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1786100654.702113:0:13234:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a3c45942000 00010000:00010000:3.0:1786100654.702116:0:13234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac0b50 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5564f2c20ac0b57 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100654.702131:0:13234:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b800/0x5564f2c20ac0d8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5564f2c20ac0d95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786100654.702137:0:13234:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b800/0x5564f2c20ac0d8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5564f2c20ac0d95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100654.702141:0:13234:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786100654.702143:0:13234:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1786100654.702145:0:13234:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1786100654.702157:0:13234:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a3c45942000 00010000:00010000:3.0:1786100654.703287:0:13234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa0b800/0x5564f2c20ac0d8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5564f2c20ac0d95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786100654.703311:0:13234:0:(import.c:65:import_set_state_nolock()) ffff9a3c45942000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1786100654.703315:0:13234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1786100654.703317:0:13234:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1786100654.703319:0:13234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1786100654.703323:0:13234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1786100654.703333:0:13234:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a3c50d88a80 x1872861960687232/t0(0) o250->MGC192.168.206.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1786100656 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1786100654.703355:0:13234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1786100654.703358:0:13234:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1786100654.703414:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28d1ade7-51d1-4427-9c4d-d62141c5468b:3304:1872861960687232:0@lo:250:kworker.0 10000000:01000000:3.0:1786100654.703593:0:13234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1786100654.703602:0:13234:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0a31 00000020:00000080:3.0:1786100654.703834:0:13234:0:(genops.c:906:class_export_put()) final put ffff9a3c45944800/28d1ade7-51d1-4427-9c4d-d62141c5468b 00000020:01000000:3.0:1786100654.703859:0:13234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.153@tcp (flags='') 00000020:00000080:3.0:1786100654.703865:0:13234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786100654.703873:0:13234:0:(obd_config.c:955:class_cleanup()) MGC192.168.206.153@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1786100654.703877:0:13234:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9a3c44f34d40) has no exports 00000020:00000080:2.0:1786100654.703881:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c45944800/28d1ade7-51d1-4427-9c4d-d62141c5468b for MGC192.168.206.153@tcp 10000000:01000000:0.0:1786100654.703994:0:5840:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1786100654.704107:0:13234:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.206.153@tcp: client import never connected 00000100:00080000:3.0:1786100654.704111:0:13234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1786100654.704113:0:13234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1786100654.704115:0:13234:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1786100654.704117:0:13234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1786100654.704180:0:12399:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3c45942000 for MGC192.168.206.153@tcp 00000020:00000080:3.0:1786100654.704185:0:13234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786100654.704194:0:13234:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.153@tcp (uuid 28d1ade7-51d1-4427-9c4d-d62141c5468b) 00000020:00000080:3.0:1786100654.704198:0:13234:0:(genops.c:906:class_export_put()) final put ffff9a3c45944000/28d1ade7-51d1-4427-9c4d-d62141c5468b 00000020:00000080:3.0:1786100654.704201:0:13234:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c45944000/28d1ade7-51d1-4427-9c4d-d62141c5468b for MGC192.168.206.153@tcp 00000020:01000000:3.0:1786100654.704206:0:13234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.153@tcp (28d1ade7-51d1-4427-9c4d-d62141c5468b) 00000020:01000000:3.0:1786100654.704540:0:13234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1786100654.704545:0:13234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786100654.704552:0:13234:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1786100654.704569:0:13234:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a3b411ef800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786100654.704575:0:13234:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9a3c7c018000) has exports, disconnecting them 00000020:00080000:3.0:1786100654.704579:0:13234:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a3b411ef800), last request at 1786100445 00000020:00000080:3.0:1786100654.704583:0:13234:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0c68 00000020:00080000:3.0:1786100654.704597:0:13234:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a3b411ef800): rc 0 00000020:00000080:3.0:1786100654.704601:0:13234:0:(genops.c:906:class_export_put()) final put ffff9a3b411ef800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1786100654.705509:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3b411ef800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1786100654.707796:0:13234:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1786100654.707804:0:13234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786100654.707808:0:13234:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1786100654.707815:0:13234:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1786100654.707903:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1786100654.708009:0:12399:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a3b411ec000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1786100654.708083:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1786100654.708198:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1786100654.708473:0:8453:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9a3c489f7000:8453] 2 exiting: rc = 0 00000100:00100000:0.0:1786100654.708557:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a3c60209000:5825] 0 exiting: rc = 1 00000100:00100000:0.0:1786100654.708603:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a3c514ffe00:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1786100654.708741:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786100654.709252:0:11178:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a3c7bfd1000:11178] 3 exiting: rc = 0 00000100:00100000:0.0:1786100654.709416:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a3c5edbd400:5827] 0 exiting: rc = 1 00000100:00100000:1.0:1786100654.709553:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a3c47248000:5828] 1 exiting: rc = 0 00000100:00100000:1.0:1786100654.709823:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a3c47249000:5829] 2 exiting: rc = 0 00000100:00100000:2.0:1786100654.709935:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.709943:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.709977:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.709987:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.709992:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.709997:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710002:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710036:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710099:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710107:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710113:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710119:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710125:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710131:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710137:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710144:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710164:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710169:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710174:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710179:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710183:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710188:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710193:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710199:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710204:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710210:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710215:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710220:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710225:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710230:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710235:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710240:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710245:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710250:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710256:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710261:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710267:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710286:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710292:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710297:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710302:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710307:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710312:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710318:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710323:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710328:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710333:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710338:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710343:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710348:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710353:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710367:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710372:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710377:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710382:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710387:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710392:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710397:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710402:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710407:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710412:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710417:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710422:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.710427:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1786100654.711157:0:13234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786100654.711167:0:13234:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1786100654.711173:0:13234:0:(genops.c:906:class_export_put()) final put ffff9a3b411ed800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1786100654.711178:0:13234:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3b411ed800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1786100654.711183:0:13234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1786100654.711217:0:13234:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a3c7f9ee000 1 00000020:00000080:2.0:1786100654.711223:0:13234:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5564f2c20ac0c0d 00000020:00000080:2.0:1786100654.711228:0:13234:0:(genops.c:906:class_export_put()) final put ffff9a3c45049000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1786100654.711248:0:13234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1786100654.711252:0:13234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786100654.711256:0:13234:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1786100654.711259:0:13234:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9a3c7f4f4d40) has no exports 00000020:00000080:0.0:1786100654.711487:0:12399:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c45049000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1786100654.754040:0:13234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786100654.754055:0:13234:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1786100654.754060:0:13234:0:(genops.c:906:class_export_put()) final put ffff9a3c7f9ed000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1786100654.754064:0:13234:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c7f9ed000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1786100654.754073:0:13234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1786100654.754235:0:13234:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a3c7f9ea000 00000020:01000000:2.0:1786100654.754262:0:13234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1786100654.754266:0:13234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786100654.754280:0:13234:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1786100654.754284:0:13234:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9a3c472dcd40) has no exports 00000020:00000080:2.0:1786100654.754305:0:13234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786100654.754311:0:13234:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1786100654.754314:0:13234:0:(genops.c:906:class_export_put()) final put ffff9a3c6d70b800/OSS_uuid 00000020:00000080:2.0:1786100654.754316:0:13234:0:(genops.c:865:class_export_destroy()) destroying export ffff9a3c6d70b800/OSS_uuid for OSS 00000020:01000000:2.0:1786100654.754320:0:13234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1786100654.757086:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a3c50d98400:6684] 1 exiting: rc = 0 00000100:00100000:1.0:1786100654.757185:0:9414:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a3c74f38000:9414] 3 exiting: rc = 0 00000100:00100000:1.0:1786100654.757239:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a3c459c2000:6683] 0 exiting: rc = 1 00000100:00080000:3.0:1786100654.757597:0:5839:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1786100654.757816:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a3c7ba08800:6686] 2 exiting: rc = 0 00000100:00100000:2.0:1786100654.758583:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758593:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758599:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758618:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758625:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758630:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758635:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758641:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758646:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758669:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758674:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758680:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758685:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758691:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758698:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758716:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758722:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758872:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758883:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758888:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758893:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758899:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758904:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758909:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758914:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758920:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758925:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758931:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758948:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758953:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758958:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758963:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758967:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758972:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758977:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758982:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758987:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758992:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.758997:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759002:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759007:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759012:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759017:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759022:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759027:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759032:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759038:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759042:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759048:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759053:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759058:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759063:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759069:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759073:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759079:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759084:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759089:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759094:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759099:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759104:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759111:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759117:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759122:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.759135:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786100654.760452:0:9757:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9a3c60055000:9757] 2 exiting: rc = 0 00000100:00100000:1.0:1786100654.760453:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a3c7ba09c00:6687] 0 exiting: rc = 1 00000100:00100000:2.0:1786100654.760555:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a3c7ba08000:6688] 1 exiting: rc = 0 00000100:00100000:3.0:1786100654.762468:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762479:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762484:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762489:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762494:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762499:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762504:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762509:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762514:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762519:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762524:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762529:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762535:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762540:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762545:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762550:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762556:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762561:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762566:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762571:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762577:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762582:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762587:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762591:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762597:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.762601:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763133:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763151:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763159:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763171:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763177:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763182:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763186:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763191:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763195:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763199:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763205:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763210:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763214:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763219:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763224:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763229:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763234:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763239:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763244:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763249:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763253:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763258:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763453:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763458:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763463:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763469:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763474:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763479:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763485:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763490:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763496:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763501:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763506:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763511:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763516:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763529:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763534:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.763547:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.764794:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a3c50d99c00:6691] 2 exiting: rc = 0 00000100:00100000:3.0:1786100654.765021:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a3c50d99000:6690] 1 exiting: rc = 0 00000100:00100000:3.0:1786100654.766686:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a3c50d99600:6689] 0 exiting: rc = 1 00000100:00100000:3.0:1786100654.766885:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766894:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766900:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766905:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766922:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766929:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766934:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766939:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766944:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766951:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766956:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766961:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766967:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766979:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766985:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766990:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.766996:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767001:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767007:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767012:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767018:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767024:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767029:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767034:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767039:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767045:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767051:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767056:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767061:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767067:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767084:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767089:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767095:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767100:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767107:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767112:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767118:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767137:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767143:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767148:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767153:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767158:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767355:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767364:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767369:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767375:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767381:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767386:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767391:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767396:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767400:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767406:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767412:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767428:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767435:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767440:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767445:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767457:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767463:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767469:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767474:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767479:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767484:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786100654.767489:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.775790:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a3c50d99e00:6692] 0 exiting: rc = 1 00000100:00100000:2.0:1786100654.776005:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a3c50d99a00:6693] 1 exiting: rc = 0 00000100:00100000:1.0:1786100654.776564:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776571:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776577:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776582:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776587:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776592:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776597:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776602:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776618:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776622:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776627:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776632:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776638:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776644:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776681:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776688:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776693:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776698:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776703:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776724:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776739:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776744:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776749:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776754:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776759:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776764:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776769:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776775:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776820:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776826:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776831:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776836:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776842:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776847:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776852:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776857:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776863:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776867:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776872:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776877:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776882:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776887:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776891:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776896:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776901:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776906:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776911:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776916:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776921:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776926:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776931:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776936:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776941:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776946:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776958:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776963:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776968:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776973:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776977:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776982:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776987:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776992:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.776996:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.777002:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.777689:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a3c48929400:6695] 1 exiting: rc = 0 00000100:00100000:2.0:1786100654.777940:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a3c48929200:6694] 0 exiting: rc = 1 00000100:00100000:1.0:1786100654.778265:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778278:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778301:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778308:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778314:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778320:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778326:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778332:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778338:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778345:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778351:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778357:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778364:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778370:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778390:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778397:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778402:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778408:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778413:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778419:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778425:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778430:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778436:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778442:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778458:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778464:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778485:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778492:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778499:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778506:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778512:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778518:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778524:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778529:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778537:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778543:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778549:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778555:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778575:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778582:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778588:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778594:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778599:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778615:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778621:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778627:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778634:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778640:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778645:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778915:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778938:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778945:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778952:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778959:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778965:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778970:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778976:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778981:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.778988:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.779002:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.779009:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.779024:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.779031:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786100654.779037:0:13234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1786100654.793867:0:13234:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1786100670.805858:0:13848:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1786100678.977035:0:14311:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786100678.977040:0:14311:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1786100678.977147:0:14311:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a3b42967000 00000020:01000004:2.0:1786100678.977160:0:14311:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1786100678.977167:0:14311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1786100678.977181:0:14311:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a3c45168000) 00000020:00000080:2.0:1786100678.977194:0:14311:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1786100679.004776:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1786100679.009456:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1786100679.010459:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1786100679.010548:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 465: rc = 0 00100000:10000000:3.0:1786100679.010670:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 465: rc = 0 00100000:10000000:3.0:1786100679.010848:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 465: rc = 0 00100000:10000000:3.0:1786100679.010958:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 465: rc = 0 00100000:10000000:3.0:1786100679.011061:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 465: rc = 0 00100000:10000000:3.0:1786100679.011172:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 465: rc = 0 00100000:10000000:3.0:1786100679.011421:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 467: rc = 0 00100000:10000000:3.0:1786100679.012815:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 603: rc = 0 00100000:10000000:3.0:1786100679.013063:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 603: rc = 0 00100000:10000000:3.0:1786100679.013579:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1786100679.014086:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:3.0:1786100679.014347:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00100000:10000000:3.0:1786100679.014616:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1786100679.015236:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00100000:10000000:3.0:1786100679.015514:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1786100679.015983:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1786100679.016225:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:3.0:1786100679.016485:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1786100679.016952:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:3.0:1786100679.017216:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:3.0:1786100679.017480:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1786100679.018087:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 665: rc = 0 00100000:10000000:3.0:1786100679.018348:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 665: rc = 0 00100000:10000000:3.0:1786100679.018609:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 665: rc = 0 00100000:10000000:3.0:1786100679.020638:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 665: rc = 0 00100000:10000000:3.0:1786100679.021068:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 665: rc = 0 00100000:10000000:3.0:1786100679.021302:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 665: rc = 0 00100000:10000000:3.0:1786100679.021544:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 665: rc = 0 00100000:10000000:3.0:1786100679.021945:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 665: rc = 0 00100000:10000000:3.0:1786100679.022192:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 665: rc = 0 00100000:10000000:3.0:1786100679.022444:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 665: rc = 0 00100000:10000000:3.0:1786100679.022727:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 665: rc = 0 00100000:10000000:3.0:1786100679.022956:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 665: rc = 0 00100000:10000000:3.0:1786100679.023197:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 665: rc = 0 00100000:10000000:3.0:1786100679.025214:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 665: rc = 0 00100000:10000000:3.0:1786100679.026006:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 665: rc = 0 00100000:10000000:3.0:1786100679.026267:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 665: rc = 0 00100000:10000000:3.0:1786100679.027517:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 665: rc = 0 00100000:10000000:3.0:1786100679.028419:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 665: rc = 0 00100000:10000000:3.0:1786100679.032267:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 665: rc = 0 00100000:10000000:3.0:1786100679.032559:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 665: rc = 0 00100000:10000000:3.0:1786100679.034440:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 665: rc = 0 00100000:10000000:3.0:1786100679.034908:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 665: rc = 0 00100000:10000000:3.0:1786100679.035152:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 665: rc = 0 00100000:10000000:3.0:1786100679.035393:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 665: rc = 0 00100000:10000000:3.0:1786100679.035686:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 665: rc = 0 00100000:10000000:3.0:1786100679.035951:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 665: rc = 0 00100000:10000000:3.0:1786100679.036189:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 665: rc = 0 00100000:10000000:3.0:1786100679.036433:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 665: rc = 0 00100000:10000000:3.0:1786100679.036742:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 665: rc = 0 00100000:10000000:3.0:1786100679.037003:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 665: rc = 0 00100000:10000000:3.0:1786100679.037263:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 665: rc = 0 00100000:10000000:2.0:1786100679.041999:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 665: rc = 0 00100000:10000000:2.0:1786100679.042404:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 360: rc = 0 00100000:10000000:2.0:1786100679.044414:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1786100679.045412:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 604: rc = 0 00100000:10000000:2.0:1786100679.045739:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1786100679.045813:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 604: rc = 0 00100000:10000000:2.0:1786100679.046035:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1786100679.046104:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 604: rc = 0 00100000:10000000:2.0:1786100679.046425:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1786100679.046508:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 608: rc = 0 00100000:10000000:2.0:1786100679.047018:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1786100679.047087:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 608: rc = 0 00100000:10000000:2.0:1786100679.047282:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1786100679.047354:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 608: rc = 0 00000020:00000080:2.0:1786100679.047627:0:14311:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1786100679.047641:0:14311:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1786100679.047670:0:14311:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac1d32 00000020:01000004:2.0:1786100679.047678:0:14311:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1786100679.047683:0:14311:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1786100679.047688:0:14311:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a3b42967000 from MGS 00000020:01000004:2.0:1786100679.047691:0:14311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1786100679.047701:0:14311:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a3c4516cd40) 00000020:00000080:2.0:1786100679.047710:0:14311:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1786100679.047761:0:14311:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a3b42967000 from MGS, refs=2 00080000:01000000:2.0:1786100679.047766:0:14311:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1786100679.047771:0:14311:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac1d40 00000100:00100000:2.0:1786100679.048003:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1786100679.048119:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1786100679.048124:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1786100679.048964:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1786100679.048973:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1786100679.049551:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786100679.049972:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1786100679.049978:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1786100679.051070:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1786100679.051081:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1786100679.051403:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1786100679.051411:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1786100679.052204:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100679.052207:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100679.052209:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100679.052597:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100679.052600:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100679.052601:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100679.053391:0:14311:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1786100679.056778:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1786100679.071426:0:14311:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1786100679.071444:0:14311:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1786100679.071447:0:14311:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1786100679.076123:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1786100679.076332:0:14311:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1786100679.076459:0:14311:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1786100679.079889:0:14311:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1786100679.082041:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786100679.082215:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1786100679.082221:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1786100679.083068:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1786100679.083077:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1786100679.083855:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1786100679.083863:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1786100679.085485:0:14311:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1786100679.085506:0:14311:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.153@tcp' 00000020:01000004:1.0:1786100679.085508:0:14311:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1786100679.085538:0:14311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.153@tcp (typ=mgc) 00000020:00000080:1.0:1786100679.085550:0:14311:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.153@tcp (ffff9a3c7f4f19c0) 00000020:00000080:1.0:1786100679.085567:0:14311:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1786100679.085677:0:14311:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a3c745ee800@MGC192.168.206.153@tcp: add connection 192.168.206.153@tcp at head 00010000:00010000:1.0:1786100679.085819:0:14311:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.153@tcp-0 is initialized 00000040:01000000:1.0:1786100679.085824:0:14311:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 1 is initialized 00000100:00080000:2.0:1786100679.086557:0:14325:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1786100679.098451:0:14326:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1786100679.099049:0:14311:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.153@tcp (uuid 0af484e0-17d7-4fef-8244-23d93563e204) 00000020:00000080:3.0:1786100679.099075:0:14311:0:(genops.c:1406:class_connect()) connect: client 0af484e0-17d7-4fef-8244-23d93563e204, cookie 0x5564f2c20ac1d4e 00000100:00080000:3.0:1786100679.099089:0:14311:0:(import.c:510:import_select_connection()) MGC192.168.206.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786100679.099096:0:14311:0:(import.c:624:import_select_connection()) MGC192.168.206.153@tcp: import ffff9a3c745ee800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:3.0:1786100679.099129:0:14311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3b42516d80 x1872861960687616/t0(0) o250->MGC192.168.206.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786100679.099201:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0af484e0-17d7-4fef-8244-23d93563e204:3304:1872861960687616:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1786100679.099266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100679.099360:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960687616 00000100:00100000:1.0:1786100679.099367:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960687616 00000100:00100000:1.0:1786100679.099402:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786100679.099413:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1872861960687616:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1786100679.099435:0:14321:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 0af484e0-17d7-4fef-8244-23d93563e204@0@lo t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:1.0:1786100679.099463:0:14321:0:(genops.c:1406:class_connect()) connect: client 0af484e0-17d7-4fef-8244-23d93563e204, cookie 0x5564f2c20ac1d55 00000100:00080000:1.0:1786100679.099608:0:14321:0:(import.c:65:import_set_state_nolock()) ffff9a3c745eb000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1786100679.099718:0:14311:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0af484e0-17d7-4fef-8244-23d93563e204->MGS 00000020:01000004:3.0:1786100679.099741:0:14311:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1786100679.099746:0:14311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1786100679.099759:0:14311:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a3c7c01cd40) 00000020:00000080:3.0:1786100679.099771:0:14311:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1786100679.104556:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+5:3304:x1872861960687616:12345-0@lo:250:mount.lustre.0 Request processed in 5136us (5280us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100679.104586:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786100679.114989:0:3304:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.206.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1786100679.115016:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.153@tcp: connect to target with instance 0 00000100:00080000:0.0:1786100679.115025:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1786100679.115031:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1786100679.115035:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c745ee800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1786100679.115038:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1786100679.115050:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1786100679.115058:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0af484e0-17d7-4fef-8244-23d93563e204:3304:1872861960687616:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1786100679.117764:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786100679.118120:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1786100679.118128:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1786100679.119272:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1786100679.119282:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1786100679.119943:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1786100679.119950:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1786100679.121034:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786100679.121194:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1786100679.121200:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1786100679.123617:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1786100679.123629:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1786100679.170959:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786100679.171131:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1786100679.171138:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1786100679.172502:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1786100679.172513:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1786100679.173488:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786100679.173941:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1786100679.173953:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1786100679.174357:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1786100679.174364:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1786100679.175288:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786100679.175443:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1786100679.175448:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1786100679.179615:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1786100679.179629:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1786100679.180594:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786100679.181156:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1786100679.181163:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1786100679.182162:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1786100679.182170:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1786100679.215752:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786100679.215950:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1786100679.215956:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1786100679.217502:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1786100679.217515:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1786100679.218520:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1786100679.218530:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1786100679.219544:0:14311:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1786100679.219567:0:14311:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1786100679.219573:0:14311:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1786100679.219726:0:14311:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1786100679.219761:0:14311:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.153@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1786100679.219765:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1786100679.219767:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786100679.219768:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786100679.219769:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786100679.219770:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786100679.219772:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786100679.219773:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786100679.219774:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786100679.219776:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786100679.219777:0:14311:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1786100679.219780:0:14311:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1786100679.219781:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786100679.219783:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786100679.219783:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786100679.219784:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786100679.219790:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786100679.219791:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786100679.219792:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786100679.219793:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786100679.219793:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786100679.219794:0:14311:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1786100679.219832:0:14311:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1786100679.219852:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960687744:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1786100679.219926:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100679.219973:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100679.220114:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960687744 00000100:00100000:1.0:1786100679.220121:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960687744 00000100:00100000:1.0:1786100679.220167:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786100679.220176:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+5:14311:x1872861960687744:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1786100679.220223:0:14324:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1786100679.220226:0:14324:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1786100679.220228:0:14324:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1786100679.220604:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1786100679.221102:0:14324:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1786100679.223016:0:14345:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1786100679.223089:0:14345:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1786100679.223092:0:14345:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1786100679.223136:0:14345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1786100679.227286:0:14324:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1786100679.227298:0:14324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1786100679.245265:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+5:14311:x1872861960687744:12345-0@lo:253:mount.lustre.0 Request processed in 25080us (25329us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100679.245286:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786100679.246185:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d88a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960687744:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1786100679.246202:0:14311:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1786100679.246206:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786100679.246207:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786100679.246209:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786100679.246210:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786100679.246211:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786100679.246212:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786100679.246214:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786100679.246215:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786100679.246217:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786100679.246218:0:14311:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1786100679.246240:0:14311:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a3b42967000 from lustre-MDT0000 10000000:01000000:3.0:1786100679.246264:0:14311:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1786100679.246267:0:14311:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1786100679.246271:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a3c7f4f19c0 10000000:01000000:3.0:1786100679.246277:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786100679.246284:0:14311:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a3c7f4f19c0 from 1 10000000:01000000:3.0:1786100679.246287:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1786100679.246321:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98e00/0x5564f2c20ac1d63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.246332:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98e00/0x5564f2c20ac1d63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.246357:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98e00/0x5564f2c20ac1d63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100679.246377:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42514700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960687872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786100679.246426:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100679.246575:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6024d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100679.246627:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960687872 00000100:00100000:1.0:1786100679.246633:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960687872 00000100:00100000:2.0:1786100679.250876:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786100679.250896:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+5:14311:x1872861960687872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786100679.250915:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100679.250936:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7f51ec00/0x5564f2c20ac1d6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1d63 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.250968:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7f51ec00/0x5564f2c20ac1d6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1d63 expref: 6 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.250977:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7f51ec00/0x5564f2c20ac1d6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1d63 expref: 6 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.251066:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51ec00, rc 0) 00000100:00100000:2.0:1786100679.251153:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+6:14311:x1872861960687872:12345-0@lo:101:mount.lustre.0 Request processed in 264us (4725us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100679.251160:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786100679.251239:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42514700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960687872:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786100679.251257:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98e00/0x5564f2c20ac1d63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d6a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100679.251266:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98e00/0x5564f2c20ac1d63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1d6a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100679.251333:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960688000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786100679.251367:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100679.252111:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960688000 00000100:00100000:3.0:1786100679.252118:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960688000 00000100:00100000:3.0:1786100679.252147:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786100679.252155:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+6:14311:x1872861960688000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786100679.252372:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+6:14311:x1872861960688000:12345-0@lo:501:mount.lustre.0 Request processed in 217us (1004us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786100679.252379:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786100679.252965:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67300 going to sleep for 11 seconds 00000100:00100000:0.0:1786100679.253063:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960688000:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1786100679.253096:0:14311:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1786100679.253150:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98e00/0x5564f2c20ac1d63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d6a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100679.253160:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98e00/0x5564f2c20ac1d63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d6a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100679.253178:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a3b42967000 10000000:01000000:0.0:1786100679.253183:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1786100679.253187:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a3b42967000 10000000:01000000:0.0:1786100679.253190:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1786100679.253193:0:14311:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a3b42967000 from 1 10000000:01000000:0.0:1786100679.253195:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1786100679.253225:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac1d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100679.253233:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac1d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100679.253242:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac1d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100679.253260:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960688128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786100679.253297:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100679.253362:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67300 going to sleep for 11 seconds 00000100:00100000:3.0:1786100679.253428:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960688128 00000100:00100000:3.0:1786100679.253434:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960688128 00000100:00100000:3.0:1786100679.253566:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786100679.253575:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+6:14311:x1872861960688128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786100679.253585:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100679.253598:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa99800/0x5564f2c20ac1d78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1d71 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.253616:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa99800/0x5564f2c20ac1d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1d71 expref: 7 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.253626:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa99800/0x5564f2c20ac1d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1d71 expref: 7 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.253647:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99800, rc 0) 00000100:00100000:3.0:1786100679.253712:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+7:14311:x1872861960688128:12345-0@lo:101:mount.lustre.0 Request processed in 139us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100679.253719:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786100679.253781:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960688128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786100679.253792:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac1d71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d78 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100679.253800:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac1d71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1d78 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100679.253812:0:14311:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1786100679.253837:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac1d71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d78 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100679.253850:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbac00/0x5564f2c20ac1d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d78 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100679.253857:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1786100679.253860:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786100679.253865:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a3b42967000 10000000:01000000:0.0:1786100679.253867:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1786100679.253870:0:14311:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1786100679.253872:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786100679.253886:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb600/0x5564f2c20ac1d7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100679.253893:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb600/0x5564f2c20ac1d7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100679.253900:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb600/0x5564f2c20ac1d7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100679.253912:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960688256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786100679.253936:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100679.254186:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67300 going to sleep for 11 seconds 00000100:00100000:1.0:1786100679.254255:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960688256 00000100:00100000:1.0:1786100679.254260:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960688256 00000100:00100000:1.0:1786100679.254283:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786100679.254290:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+7:14311:x1872861960688256:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786100679.254297:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100679.254310:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4165e000/0x5564f2c20ac1d86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1d7f expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100679.254335:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4165e000/0x5564f2c20ac1d86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1d7f expref: 8 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100679.254343:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4165e000/0x5564f2c20ac1d86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1d7f expref: 8 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100679.254350:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165e000, rc 0) 00000100:00100000:1.0:1786100679.254391:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+8:14311:x1872861960688256:12345-0@lo:101:mount.lustre.0 Request processed in 102us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100679.254397:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786100679.254485:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960688256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786100679.254496:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb600/0x5564f2c20ac1d7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d86 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100679.254503:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb600/0x5564f2c20ac1d7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1d86 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100679.254562:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960688384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786100679.254588:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100679.254610:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67300 going to sleep for 11 seconds 00000100:00100000:1.0:1786100679.254723:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960688384 00000100:00100000:1.0:1786100679.254728:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960688384 00000100:00100000:1.0:1786100679.254744:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786100679.254750:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+8:14311:x1872861960688384:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786100679.255223:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+9:14311:x1872861960688384:12345-0@lo:501:mount.lustre.0 Request processed in 471us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100679.255230:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786100679.257015:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960688384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786100679.257071:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960688512:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786100679.257137:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100679.257180:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67300 going to sleep for 11 seconds 00000100:00100000:1.0:1786100679.257298:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960688512 00000100:00100000:1.0:1786100679.257304:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960688512 00000100:00100000:1.0:1786100679.257336:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786100679.257343:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+9:14311:x1872861960688512:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786100679.257717:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+9:14311:x1872861960688512:12345-0@lo:503:mount.lustre.0 Request processed in 372us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100679.257725:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786100679.258204:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960688512:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786100679.260199:0:14346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0af484e0-17d7-4fef-8244-23d93563e204:14346:1872861960688640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100679.260277:0:14346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100679.260319:0:14346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100679.261448:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960688640 00000100:00100000:3.0:1786100679.261459:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960688640 00000100:00100000:3.0:1786100679.261532:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786100679.261543:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+9:14346:x1872861960688640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100679.262147:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+9:14346:x1872861960688640:12345-0@lo:502:llog_process_th.0 Request processed in 603us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100679.262155:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786100679.262481:0:14346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0af484e0-17d7-4fef-8244-23d93563e204:14346:1872861960688640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786100679.262526:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100679.262537:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100679.262539:0:14346:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1786100679.262544:0:14346:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1786100679.262547:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786100679.262561:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a3c7fa54d40) 00000020:00000080:0.0:1786100679.262578:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1786100679.262584:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1786100679.262668:0:14346:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1786100679.262676:0:14346:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac1d94 00000020:00000080:0.0:1786100679.263228:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1786100679.263233:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100679.263238:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100679.263247:0:14346:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1786100679.263251:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100679.263255:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100679.263256:0:14346:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1786100679.263259:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786100679.263267:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a3c7fa53380) 00000020:00000080:0.0:1786100679.263278:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1786100679.263283:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1786100679.263285:0:14346:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1786100679.263287:0:14346:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1786100679.263293:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1786100679.263336:0:14346:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a3b42967000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1786100679.263348:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a3c7fa519c0) 00000020:00000080:0.0:1786100679.263358:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1786100679.263424:0:14346:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1786100679.263431:0:14346:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5564f2c20ac1da9 00000020:00000080:0.0:1786100679.263809:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1786100679.263960:0:14346:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1786100679.263967:0:14346:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5564f2c20ac1db0 00080000:01000000:0.0:1786100679.263973:0:14346:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1786100679.263977:0:14346:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac1db7 00010000:00010000:1.0:1786100679.381290:0:14346:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1786100679.381742:0:14346:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:1.0:1786100679.383252:0:14346:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1786100679.383906:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a3c7f4f0000) 00000020:00000080:1.0:1786100679.383923:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1786100679.384005:0:14346:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1786100679.384012:0:14346:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac1dc5 00000020:00000080:3.0:1786100679.387195:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1786100679.401729:0:14346:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5564f2c20ac1dcc 00000020:00000080:1.0:1786100679.404407:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1786100679.404422:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786100679.404429:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100679.404431:0:14346:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1786100679.404435:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1786100679.404438:0:14346:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1786100679.404439:0:14346:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786100679.404441:0:14346:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786100679.404443:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1786100679.404446:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100679.404447:0:14346:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1786100679.404450:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786100679.404456:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100679.404457:0:14346:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1786100679.404462:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1786100679.404520:0:14346:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1786100679.404533:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786100679.404537:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100679.404538:0:14346:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1786100679.404540:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786100679.404544:0:14346:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1786100679.404547:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786100679.404548:0:14346:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1786100679.404550:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1786100679.404556:0:14346:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.153@tcp to nid 0x20000c0a8ce99 (192.168.206.153@tcp) 00000020:01000000:1.0:1786100679.404580:0:14346:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1786100679.404583:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786100679.404608:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a3c7f4f4d40) 00000020:00000080:1.0:1786100679.404625:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1786100679.404632:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1786100679.404719:0:14346:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1786100679.404725:0:14346:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1786100679.404732:0:14346:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac1dda 00010000:00080000:1.0:1786100679.404764:0:14346:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a3c7cea7800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.153@tcp at head 00010000:00010000:1.0:1786100679.405203:0:14346:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1786100679.407173:0:14346:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1786100679.407268:0:14346:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1786100679.408705:0:14346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786100679.408759:0:14346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1786100679.409314:0:14346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000020:00000080:0.0:1786100679.410378:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786100679.410391:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1786100679.410422:0:14346:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1786100679.410440:0:14346:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5564f2c20ac1de1 00000100:00080000:0.0:1786100679.410450:0:14346:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786100679.410456:0:14346:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a3c7cea7800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:0.0:1786100679.410513:0:14346:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3c50d8bb80 x1872861960688768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786100679.410544:0:14346:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1786100679.410600:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100679.410604:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100679.410614:0:14346:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1786100679.410618:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1786100679.410620:0:14346:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1786100679.410622:0:14346:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786100679.410623:0:14346:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786100679.410625:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1786100679.410627:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100679.410629:0:14346:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1786100679.410631:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786100679.410636:0:14346:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1786100679.410640:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100679.410641:0:14346:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1786100679.410644:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1786100679.410675:0:14346:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.153@tcp to nid 0x20000c0a8ce99 (192.168.206.153@tcp) 00000020:01000000:0.0:1786100679.410701:0:14346:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1786100679.410704:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786100679.410716:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a3c7fa50000) 00000020:00000080:0.0:1786100679.410728:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1786100679.410732:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1786100679.411518:0:14346:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1786100679.411528:0:14346:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1786100679.411537:0:14346:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5564f2c20ac1def 00010000:00080000:0.0:1786100679.411571:0:14346:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a3c60f67000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.153@tcp at head 00000100:00100000:2.0:1786100679.414355:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960688768:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1786100679.414427:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872861960688768 offset 0 length 520: 4 00010000:00010000:0.0:1786100679.415057:0:14346:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:00080000:1.0:1786100679.415515:0:14350:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1786100679.415522:0:14350:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000040:01000000:0.0:1786100679.416061:0:14346:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1786100679.416089:0:14346:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1786100679.416803:0:14346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786100679.419169:0:14346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1786100679.419260:0:14346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1786100679.419927:0:14352:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1786100679.419932:0:14352:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1786100679.420647:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786100679.420804:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1786100679.420909:0:14346:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1786100679.420928:0:14346:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5564f2c20ac1df6 00000100:00080000:3.0:1786100679.420939:0:14346:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786100679.420944:0:14346:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a3c60f67000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:3.0:1786100679.420980:0:14346:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3b42517100 x1872861960688896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786100679.421007:0:14346:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1786100679.421082:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960688896:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1786100679.421146:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872861960688896 offset 0 length 520: 4 00000020:01000000:3.0:1786100679.421256:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786100679.421260:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786100679.421267:0:14346:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1786100679.421270:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786100679.421274:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786100679.421275:0:14346:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1786100679.421278:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1786100679.421279:0:14346:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1786100679.421281:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786100679.421284:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786100679.421285:0:14346:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1786100679.421287:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786100679.421289:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786100679.421290:0:14346:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1786100679.421293:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1786100679.421319:0:14346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0af484e0-17d7-4fef-8244-23d93563e204:14346:1872861960689024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100679.421367:0:14346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100679.421394:0:14346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c514a26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100679.421544:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960689024 00000100:00100000:1.0:1786100679.421551:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960689024 00000100:00100000:1.0:1786100679.421597:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786100679.421607:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+9:14346:x1872861960689024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786100679.421895:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+9:14346:x1872861960689024:12345-0@lo:502:llog_process_th.0 Request processed in 288us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100679.421904:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786100679.422168:0:14346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0af484e0-17d7-4fef-8244-23d93563e204:14346:1872861960689024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786100679.422195:0:14346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786100679.422202:0:14346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786100679.422203:0:14346:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1786100679.422208:0:14346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1786100679.422546:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1786100679.422565:0:14311:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1786100679.422586:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb600/0x5564f2c20ac1d7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d86 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100679.422596:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb600/0x5564f2c20ac1d7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d86 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100679.422617:0:14311:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a3b42967000 from 1 10000000:01000000:1.0:1786100679.422620:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786100679.422678:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100679.422686:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100679.422696:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100679.422714:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960689152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786100679.422754:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100679.423095:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960689152 00000100:00100000:3.0:1786100679.423100:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960689152 00000100:00100000:3.0:1786100679.423134:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786100679.423141:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+9:14311:x1872861960689152:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786100679.423152:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100679.423165:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa99000/0x5564f2c20ac1e04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1dfd expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.423187:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa99000/0x5564f2c20ac1e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1dfd expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.423208:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa99000/0x5564f2c20ac1e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1dfd expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.423217:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99000, rc 0) 00000100:00100000:3.0:1786100679.423250:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+10:14311:x1872861960689152:12345-0@lo:101:mount.lustre.0 Request processed in 109us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100679.423255:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786100679.426582:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47099780 going to sleep for 11 seconds 00000100:00100000:3.0:1786100679.426716:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960689152:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786100679.426739:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e04 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.426752:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1e04 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100679.427381:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960689280:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1786100679.427445:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100679.427495:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4802a240 going to sleep for 11 seconds 00000100:00100000:1.0:1786100679.427573:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960689280 00000100:00100000:1.0:1786100679.427579:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960689280 00000100:00100000:1.0:1786100679.427623:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786100679.427633:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+10:14311:x1872861960689280:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1786100679.427670:0:14323:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1786100679.427677:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1786100679.427747:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+10:14311:x1872861960689280:12345-0@lo:256:mount.lustre.0 Request processed in 115us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100679.427754:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786100679.429055:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960689280:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1786100679.429639:0:14311:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786100679.429678:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e04 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.429690:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e04 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100679.429698:0:14311:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3b42967000 from 1 10000000:01000000:3.0:1786100679.429711:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786100679.429744:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.429751:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.429760:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100679.429778:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960689408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786100679.430150:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100679.430190:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4802a240 going to sleep for 11 seconds 00000100:00100000:1.0:1786100679.430438:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960689408 00000100:00100000:1.0:1786100679.430444:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960689408 00000100:00100000:1.0:1786100679.430512:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786100679.430522:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+10:14311:x1872861960689408:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786100679.430544:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100679.430558:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4165e400/0x5564f2c20ac1e12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1e0b expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100679.430580:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4165e400/0x5564f2c20ac1e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1e0b expref: 11 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100679.430590:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4165e400/0x5564f2c20ac1e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1e0b expref: 11 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100679.430598:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165e400, rc 0) 00000100:00100000:1.0:1786100679.430637:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+11:14311:x1872861960689408:12345-0@lo:101:mount.lustre.0 Request processed in 116us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100679.430644:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786100679.433147:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960689408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786100679.433172:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e12 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.433184:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1e12 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100679.433254:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960689536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786100679.433305:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100679.433351:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4802a240 going to sleep for 11 seconds 00000100:00100000:1.0:1786100679.433407:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960689536 00000100:00100000:1.0:1786100679.433413:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960689536 00000100:00100000:1.0:1786100679.433461:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786100679.433480:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+11:14311:x1872861960689536:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786100679.433896:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+11:14311:x1872861960689536:12345-0@lo:501:mount.lustre.0 Request processed in 417us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100679.433904:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786100679.435910:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960689536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786100679.435970:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960689664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786100679.436042:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100679.436083:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100679.437089:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960689664 00000100:00100000:3.0:1786100679.437098:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960689664 00000100:00100000:3.0:1786100679.437144:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786100679.437153:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+11:14311:x1872861960689664:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786100679.437341:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+11:14311:x1872861960689664:12345-0@lo:503:mount.lustre.0 Request processed in 189us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100679.437355:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786100679.437777:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960689664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786100679.438350:0:14354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0af484e0-17d7-4fef-8244-23d93563e204:14354:1872861960689792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100679.438396:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100679.438433:0:14354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67000 going to sleep for 11 seconds 00000100:00100000:3.0:1786100679.438493:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960689792 00000100:00100000:3.0:1786100679.438498:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960689792 00000100:00100000:3.0:1786100679.438532:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786100679.438540:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+11:14354:x1872861960689792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100679.438775:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+11:14354:x1872861960689792:12345-0@lo:502:llog_process_th.0 Request processed in 235us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100679.438783:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786100679.439066:0:14354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0af484e0-17d7-4fef-8244-23d93563e204:14354:1872861960689792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786100679.439092:0:14354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100679.439101:0:14354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100679.439103:0:14354:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1786100679.439109:0:14354:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a3b42967000 00000020:00000080:0.0:1786100679.439112:0:14354:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786100679.439119:0:14354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100679.439121:0:14354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100679.439123:0:14354:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1786100679.439125:0:14354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100679.439128:0:14354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100679.439129:0:14354:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1786100679.439132:0:14354:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a3b42967000 00000020:00000080:0.0:1786100679.439133:0:14354:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786100679.439228:0:14354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100679.439232:0:14354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100679.439234:0:14354:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1786100679.439236:0:14354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100679.439238:0:14354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100679.439239:0:14354:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1786100679.439242:0:14354:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a3b42967000 00000020:00000080:0.0:1786100679.439244:0:14354:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1786100679.445986:0:14354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0af484e0-17d7-4fef-8244-23d93563e204:14354:1872861960689920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786100679.446073:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100679.446122:0:14354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67000 going to sleep for 11 seconds 00000100:00100000:2.0:1786100679.446406:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960689920 00000100:00100000:2.0:1786100679.446416:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960689920 00000100:00100000:2.0:1786100679.446477:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786100679.446487:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+11:14354:x1872861960689920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786100679.446740:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+11:14354:x1872861960689920:12345-0@lo:502:llog_process_th.0 Request processed in 254us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100679.446748:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786100679.447165:0:14354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0af484e0-17d7-4fef-8244-23d93563e204:14354:1872861960689920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786100679.447199:0:14354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100679.447209:0:14354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100679.447211:0:14354:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1786100679.447215:0:14354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1786100679.447559:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1786100679.447578:0:14311:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786100679.447603:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e12 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.447614:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e12 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100679.447685:0:14311:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1786100679.447688:0:14311:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a3b42967000 10000000:01000000:2.0:1786100679.447691:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a3b42967000 10000000:01000000:2.0:1786100679.447696:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786100679.447702:0:14311:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a3b42967000 from 1 10000000:01000000:2.0:1786100679.447704:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786100679.447734:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7f51e400/0x5564f2c20ac1e19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.447743:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7f51e400/0x5564f2c20ac1e19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.447753:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7f51e400/0x5564f2c20ac1e19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100679.447771:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960690048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1786100679.448072:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100679.448112:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6020c000 going to sleep for 11 seconds 00000100:00100000:0.0:1786100679.448279:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960690048 00000100:00100000:0.0:1786100679.448286:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960690048 00000100:00100000:0.0:1786100679.448331:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786100679.448340:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+11:14311:x1872861960690048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786100679.448351:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100679.448365:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbbc00/0x5564f2c20ac1e20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1e19 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100679.448384:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbbc00/0x5564f2c20ac1e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1e19 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100679.448393:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbbbc00/0x5564f2c20ac1e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1e19 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100679.448402:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbbc00, rc 0) 00000100:00100000:0.0:1786100679.448435:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+12:14311:x1872861960690048:12345-0@lo:101:mount.lustre.0 Request processed in 96us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100679.448441:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786100679.448567:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960690048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786100679.448580:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7f51e400/0x5564f2c20ac1e19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e20 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.448589:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7f51e400/0x5564f2c20ac1e19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1e20 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100679.448632:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960690176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786100679.448690:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100679.448710:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6020c000 going to sleep for 11 seconds 00000100:00100000:3.0:1786100679.448807:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960690176 00000100:00100000:3.0:1786100679.448812:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960690176 00000100:00100000:3.0:1786100679.449011:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786100679.449019:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+12:14311:x1872861960690176:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786100679.449253:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+12:14311:x1872861960690176:12345-0@lo:501:mount.lustre.0 Request processed in 234us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100679.449260:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786100679.449347:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960690176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786100679.449375:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960690304:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786100679.449417:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100679.449449:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6020c000 going to sleep for 11 seconds 00000100:00100000:3.0:1786100679.449506:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960690304 00000100:00100000:3.0:1786100679.449510:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960690304 00000100:00100000:3.0:1786100679.449540:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786100679.449547:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+12:14311:x1872861960690304:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786100679.449722:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+12:14311:x1872861960690304:12345-0@lo:503:mount.lustre.0 Request processed in 175us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100679.449729:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786100679.449967:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960690304:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786100679.451932:0:14357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0af484e0-17d7-4fef-8244-23d93563e204:14357:1872861960690432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786100679.452003:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100679.452077:0:14357:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100679.452150:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960690432 00000100:00100000:3.0:1786100679.452157:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960690432 00000100:00100000:3.0:1786100679.452234:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1786100679.452245:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+12:14357:x1872861960690432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786100679.452515:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+12:14357:x1872861960690432:12345-0@lo:502:llog_process_th.0 Request processed in 271us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100679.452523:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786100679.452718:0:14357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0af484e0-17d7-4fef-8244-23d93563e204:14357:1872861960690432:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1786100679.452789:0:14357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1786100679.452803:0:14357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a3c7f4f3380) 00000020:00000080:1.0:1786100679.452828:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1786100679.455094:0:14357:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a3b42967000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1786100679.455104:0:14357:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a3b42967000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1786100679.455107:0:14357:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a3b42967000 4 00010000:00080000:1.0:1786100679.467881:0:14357:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a3c7f867000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.153@tcp at head 00010000:00010000:1.0:1786100679.469543:0:14357:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1786100679.469642:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1786100679.469700:0:14357:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1786100679.469713:0:14357:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5564f2c20ac1e2e 00000100:00080000:1.0:1786100679.469722:0:14357:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1786100679.469728:0:14357:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a3c7f867000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:1.0:1786100679.469761:0:14357:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3c7c10dc00 x1872861960690560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786100679.469810:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1872861960690560:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1786100679.469873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786100679.469933:0:14357:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1786100679.470357:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960690560 00000100:00100000:2.0:1786100679.470365:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960690560 00000100:00100000:2.0:1786100679.470401:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786100679.470409:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1872861960690560:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786100679.470475:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1872861960690560:12345-0@lo:38:llog_process_th.0 Request processed in 53us (589us total) trans 0 rc -11/-11 00000100:00100000:2.0:1786100679.470482:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786100679.476160:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786100679.476174:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c7f867000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786100679.476181:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1786100679.476186:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1872861960690560:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1786100679.477641:0:14357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0af484e0-17d7-4fef-8244-23d93563e204:14357:1872861960690688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786100679.484161:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100679.484201:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960690688 00000100:00100000:1.0:1786100679.484208:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960690688 00000100:00100000:1.0:1786100679.484248:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1786100679.484258:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+12:14357:x1872861960690688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786100679.484503:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+12:14357:x1872861960690688:12345-0@lo:502:llog_process_th.0 Request processed in 246us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100679.484512:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1786100679.484562:0:14357:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736900 going to sleep for 11 seconds 00000100:00100000:1.0:1786100679.484582:0:14357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0af484e0-17d7-4fef-8244-23d93563e204:14357:1872861960690688:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1786100679.484613:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1786100679.491763:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1786100679.491819:0:14311:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786100679.491842:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7f51e400/0x5564f2c20ac1e19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e20 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100679.491853:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7f51e400/0x5564f2c20ac1e19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e20 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1786100679.491901:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1786100679.491903:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786100679.491904:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786100679.491905:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786100679.491907:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786100679.491908:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786100679.491910:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786100679.491911:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786100679.491913:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786100679.491914:0:14311:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1786100679.491918:0:14311:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1786100679.491920:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786100679.491921:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786100679.491922:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786100679.491924:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786100679.491925:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786100679.491926:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786100679.491927:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786100679.491928:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786100679.491929:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786100679.491930:0:14311:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1786100679.491955:0:14311:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1786100679.491975:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960690816:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1786100679.492049:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100679.492087:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4802a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100679.492176:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960690816 00000100:00100000:3.0:1786100679.492183:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960690816 00000100:00100000:3.0:1786100679.492223:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786100679.492231:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+12:14311:x1872861960690816:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1786100679.492257:0:14321:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1786100679.492269:0:14321:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1786100679.547018:0:14321:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786100679.547066:0:14321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1786100679.552823:0:14344:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786100679.552832:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786100679.552854:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100679.552872:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa99000/0x5564f2c20ac1e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1dfd expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100679.552881:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100679.552921:0:14344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa99000/0x5564f2c20ac1e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac1dfd expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100679.552935:0:14344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c7fa99000/0x5564f2c20ac1e04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac1dfd expref: 12 pid: 14324 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100679.552949:0:14344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14344:1872861960690944:0@lo:104: 00000100:00100000:1.0:1786100679.553011:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100679.553061:0:14344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786100679.553208:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960690944 00000100:00100000:2.0:1786100679.553215:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960690944 00000100:00100000:2.0:1786100679.553258:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786100679.553268:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0af484e0-17d7-4fef-8244-23d93563e204+3:14344:x1872861960690944:12345-0@lo:104: 00010000:00010000:2.0:1786100679.553295:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1e04 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.553355:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786100679.553361:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0af484e0-17d7-4fef-8244-23d93563e204+3:14344:x1872861960690944:12345-0@lo:104: Request processed in 95us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100679.553369:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1786100679.553388:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100679.553393:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1e04 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.553400:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165ec00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:2.0:1786100679.553404:0:14318:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac1e04 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.553413:0:14318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac1e04 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786100679.553420:0:14318:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac1e04 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100679.553425:0:14318:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1786100679.553451:0:14318:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1e04 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.553458:0:14318:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1786100679.553927:0:14344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14344:1872861960690944:0@lo:104: 00010000:00010000:1.0:1786100679.553944:0:14344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554556:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1e04 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554565:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1dfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1e04 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554591:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100679.554593:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100679.554595:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100679.554623:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786100679.554635:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960691072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786100679.554698:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100679.554754:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960691072 00000100:00100000:2.0:1786100679.554759:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960691072 00010000:00010000:2.0:1786100679.554782:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa99000/0x5564f2c20ac1e04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1dfd expref: 13 pid: 14324 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100679.554807:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786100679.554815:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0af484e0-17d7-4fef-8244-23d93563e204+13:3308:x1872861960691072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786100679.554828:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100679.554833:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa99000/0x5564f2c20ac1e04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1dfd expref: 13 pid: 14324 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554842:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa99000/0x5564f2c20ac1e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac1dfd expref: 13 pid: 14324 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554857:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa99000/0x5564f2c20ac1e04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac1dfd expref: 13 pid: 14324 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554870:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554878:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786100679.554901:0:14314:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002069972s 00010000:00010000:2.0:1786100679.554906:0:14314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554912:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554919:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554926:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554932:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f000 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100679.554935:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554943:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554959:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.554968:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100679.555002:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0af484e0-17d7-4fef-8244-23d93563e204+12:3308:x1872861960691072:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100679.555010:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786100679.555042:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960691072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786100679.555060:0:14344:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.555075:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100679.555081:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4165f000/0x5564f2c20ac1e35 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100679.555646:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+11:14311:x1872861960690816:12345-0@lo:253:mount.lustre.0 Request processed in 63413us (63594us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100679.555705:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786100679.555869:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:14311:1872861960690816:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1786100679.555880:0:14311:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1786100679.555883:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786100679.555885:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786100679.555886:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786100679.555888:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786100679.555889:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786100679.555890:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786100679.555891:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786100679.555892:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786100679.555894:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786100679.555896:0:14311:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1786100679.555907:0:14311:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1786100679.561241:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100679.561397:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1786100679.561838:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100679.562002:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1786100679.562293:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100679.562454:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1786100679.564029:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100679.564177:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1786100679.564442:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100679.564886:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1786100679.565164:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100679.565324:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1786100679.594435:0:14311:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1786100679.594947:0:14311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1786100679.595199:0:14367:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1786100679.595272:0:14367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786100679.597441:0:14367:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1786100679.597524:0:14367:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1786100679.597528:0:14367:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:3.0:1786100679.599768:0:14366:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1786100679.599773:0:14366:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1786100679.600606:0:14311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1786100679.600782:0:14311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1786100679.601293:0:14311:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1786100679.601301:0:14311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1786100679.601437:0:14311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786100679.602412:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1786100679.603024:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1786100679.603057:0:14311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1786100679.603455:0:14311:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1786100679.604590:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1786100679.609378:0:14311:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1786100679.636184:0:14311:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1786100679.636227:0:14311:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa94fc17d3988 00100000:10000000:3.0:1786100679.636236:0:14311:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1786100679.636977:0:14311:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1786100679.636992:0:14311:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1786100679.637007:0:14311:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1786100679.637026:0:14311:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1786100680.100895:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786100680.559526:0:14362:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786100680.559535:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786100680.563865:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1786100680.563877:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:1.0:1786100680.940353:0:14326:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1786100680.940361:0:14326:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a3b42967000 from 6 10000000:01000000:1.0:1786100680.940366:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786100680.940412:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100680.940424:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100680.940436:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100680.940470:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960691200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786100680.940551:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100680.940608:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736780 going to sleep for 11 seconds 00000100:00100000:3.0:1786100680.940690:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960691200 00000100:00100000:3.0:1786100680.940697:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960691200 00000100:00100000:3.0:1786100680.940742:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786100680.940752:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+11:14326:x1872861960691200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100680.940765:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100680.940779:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac1e43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1e3c expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100680.940803:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac1e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1e3c expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100680.940813:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac1e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1e3c expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100680.940822:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98000, rc 0) 00000100:00100000:3.0:1786100680.940865:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+12:14326:x1872861960691200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100680.940890:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786100680.940940:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960691200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100680.940953:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e43 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100680.940961:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1e43 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100680.941015:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960691328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786100680.941046:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100680.941064:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c51a90540 going to sleep for 11 seconds 00000100:00100000:0.0:1786100680.941221:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960691328 00000100:00100000:0.0:1786100680.941225:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960691328 00000100:00100000:0.0:1786100680.941260:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786100680.941267:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+12:14326:x1872861960691328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786100680.941281:0:14321:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786100680.941297:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786100680.941300:0:14321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1786100680.941384:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+12:14326:x1872861960691328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100680.941391:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786100680.941422:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960691328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1786100680.941474:0:14326:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786100680.941481:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e43 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100680.941488:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e43 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100681.128596:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786100681.574310:0:14362:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786100681.574318:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786100681.574858:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1786100681.574913:0:14362:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786100681.574940:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:0.0:1786100682.150081:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100683.174489:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786100684.088104:0:14609:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1786100684.200099:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786100684.710646:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786100684.710666:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1786100684.710669:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786100684.710681:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1786100684.710684:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1786100684.710688:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786100684.710692:0:467:0:(import.c:65:import_set_state_nolock()) ffff9a3c7f867000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786100684.710707:0:467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a3c7f867000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:1.0:1786100684.710733:0:467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3c7c10e300 x1872861960691584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786100684.712530:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960691456:0@lo:400:kworker.0 00000100:00100000:2.0:1786100684.712619:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100684.712730:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1872861960691584:0@lo:38:kworker.0 00000100:00100000:2.0:1786100684.712765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100684.713410:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960691456 00000100:00100000:1.0:1786100684.713422:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960691456 00000100:00100000:1.0:1786100684.713503:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786100684.713515:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+12:3308:x1872861960691456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100684.713595:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+12:3308:x1872861960691456:12345-0@lo:400:kworker.0 Request processed in 82us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100684.713603:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786100684.713676:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960691456:0@lo:400:kworker.0 00000100:00100000:3.0:1786100684.719990:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960691584 00000100:00100000:3.0:1786100684.720014:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960691584 00000100:00100000:3.0:1786100684.720062:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786100684.720071:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1872861960691584:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1786100684.720107:0:14330:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:3.0:1786100684.720156:0:14330:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5564f2c20ac1e4a 00000004:00100000:3.0:1786100684.720177:0:14330:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1786100684.720511:0:14330:0:(import.c:65:import_set_state_nolock()) ffff9a3c6e1b1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786100684.720631:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1872861960691584:12345-0@lo:38:kworker.0 Request processed in 560us (7864us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100684.720641:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1786100684.720907:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a3c7c10e300 x1872861960691584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786100694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786100684.720928:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1786100684.720937:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1786100684.720943:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1786100684.720946:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c7f867000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1786100684.720952:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1872861960691584:0@lo:38:kworker.0 00010000:00010000:3.0:1786100685.222456:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100686.249462:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786100687.141541:0:14760:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc865c3520 20000000:00000080:3.0:1786100687.141562:0:14760:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a3c75f81800 uarg=0000000000000000 20000000:01000000:3.0:1786100687.141616:0:14760:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1786100687.141625:0:14760:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1786100687.141631:0:14760:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1786100687.143077:0:14761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1786100687.143270:0:14760:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1786100687.154739:0:14760:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1786100687.155199:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.155226:0:14760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4165e400/0x5564f2c20ac1e12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1e0b expref: 11 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.155235:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.155294:0:14760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4165e400/0x5564f2c20ac1e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac1e0b expref: 11 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.155336:0:14760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c4165e400/0x5564f2c20ac1e12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac1e0b expref: 11 pid: 14321 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100687.155356:0:14760:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14760:1872861960691712:0@lo:104: 00000100:00100000:1.0:1786100687.155454:0:14760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100687.155585:0:14760:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c50d2a840 going to sleep for 11 seconds 00000100:00100000:2.0:1786100687.159217:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960691712 00000100:00100000:2.0:1786100687.159237:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960691712 00000100:00100000:2.0:1786100687.159386:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786100687.159399:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0af484e0-17d7-4fef-8244-23d93563e204+3:14760:x1872861960691712:12345-0@lo:104: 00010000:00010000:2.0:1786100687.159497:0:14313:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1e12 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100687.159673:0:14313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786100687.159680:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0af484e0-17d7-4fef-8244-23d93563e204+3:14760:x1872861960691712:12345-0@lo:104: Request processed in 284us (4225us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100687.159687:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786100687.159707:0:14760:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14760:1872861960691712:0@lo:104: 00010000:00010000:1.0:1786100687.159737:0:14760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100687.159823:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100687.159832:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1e12 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100687.159840:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99200 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:3.0:1786100687.159845:0:14318:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac1e12 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100687.159854:0:14318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac1e12 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786100687.159862:0:14318:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac1e12 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100687.159868:0:14318:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786100687.159914:0:14318:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1e12 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100687.159920:0:14318:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1786100687.159999:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0af484e0-17d7-4fef-8244-23d93563e204:3305:1872861960691840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786100687.160048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786100687.160130:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1e12 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100687.160139:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99200/0x5564f2c20ac1e0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1e12 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100687.160153:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960691840 00010000:00010000:3.0:1786100687.160158:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100687.160159:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100687.160159:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960691840 00010000:00010000:3.0:1786100687.160175:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100687.160181:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4165e400/0x5564f2c20ac1e12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1e0b expref: 12 pid: 14321 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100687.160214:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786100687.160222:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0af484e0-17d7-4fef-8244-23d93563e204+12:3305:x1872861960691840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786100687.160235:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100687.160241:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4165e400/0x5564f2c20ac1e12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1e0b expref: 12 pid: 14321 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.160253:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4165e400/0x5564f2c20ac1e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac1e0b expref: 12 pid: 14321 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.160269:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4165e400/0x5564f2c20ac1e12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac1e0b expref: 12 pid: 14321 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.160285:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.160301:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.160317:0:14314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.160326:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.160333:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.160339:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.160345:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165e600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100687.160349:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.160357:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.160370:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100687.160380:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786100687.160383:0:14760:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100687.160391:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100687.160403:0:14760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4165e600/0x5564f2c20ac1e51 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100687.167452:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0af484e0-17d7-4fef-8244-23d93563e204+11:3305:x1872861960691840:12345-0@lo:103:ldlm_bl.0 Request processed in 7216us (7388us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100687.167471:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786100687.167820:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0af484e0-17d7-4fef-8244-23d93563e204:3305:1872861960691840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786100687.271359:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100688.304157:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786100688.485787:0:14326:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786100688.485799:0:14326:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3b42967000 from 10 10000000:01000000:0.0:1786100688.485806:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786100688.485865:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100688.485879:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100688.485891:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100688.485922:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960691968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786100688.486028:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100688.486089:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c412edd80 going to sleep for 11 seconds 00000100:00100000:1.0:1786100688.486326:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960691968 00000100:00100000:1.0:1786100688.486354:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960691968 00000100:00100000:1.0:1786100688.486444:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786100688.486457:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+11:14326:x1872861960691968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786100688.486476:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100688.486845:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4165ee00/0x5564f2c20ac1e5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1e58 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100688.486880:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4165ee00/0x5564f2c20ac1e5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1e58 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100688.486892:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4165ee00/0x5564f2c20ac1e5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1e58 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100688.486904:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4165ee00, rc 0) 00000100:00100000:1.0:1786100688.487036:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+12:14326:x1872861960691968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 580us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100688.487044:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786100688.487154:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960691968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786100688.487175:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e5f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100688.487184:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1e5f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100688.487260:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960692096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100688.487294:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100688.487342:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c412edd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786100688.487393:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960692096 00000100:00100000:2.0:1786100688.487399:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960692096 00000100:00100000:2.0:1786100688.487457:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786100688.487468:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+12:14326:x1872861960692096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100688.488298:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+12:14326:x1872861960692096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 826us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100688.488319:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786100688.489105:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960692096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100688.489200:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960692224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786100688.489276:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100688.489329:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c50d2aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1786100688.489638:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960692224 00000100:00100000:0.0:1786100688.489646:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960692224 00000100:00100000:0.0:1786100688.489807:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786100688.489818:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+12:14326:x1872861960692224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100688.491239:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+12:14326:x1872861960692224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1413us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100688.491254:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786100688.492156:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960692224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786100688.495453:0:14821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1786100688.496892:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1786100688.496922:0:14326:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786100688.496946:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e5f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100688.497028:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e5f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100689.319403:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786100689.828800:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786100689.828806:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1786100689.828809:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786100689.828812:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1786100689.828839:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786100689.828855:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0af484e0-17d7-4fef-8244-23d93563e204:3305:1872861960692352:0@lo:400:kworker.0 00000100:00100000:2.0:1786100689.828915:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100689.828964:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960692480:0@lo:400:kworker.0 00000100:00100000:2.0:1786100689.828985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100689.829016:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960692352 00000100:00100000:2.0:1786100689.829023:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960692352 00000100:00100000:2.0:1786100689.829056:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786100689.829064:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+12:3305:x1872861960692352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100689.829102:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+12:3305:x1872861960692352:12345-0@lo:400:kworker.0 Request processed in 39us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100689.829108:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786100689.829154:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960692480 00000100:00100000:2.0:1786100689.829157:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960692480 00000100:00100000:2.0:1786100689.829180:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786100689.829186:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960692480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100689.829220:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960692480:12345-0@lo:400:kworker.0 Request processed in 34us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100689.829239:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1786100689.829273:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a3c473d0380 x1872861960692480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100689.829285:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960692480:0@lo:400:kworker.0 00000100:00100000:2.0:1786100689.829311:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0af484e0-17d7-4fef-8244-23d93563e204:3305:1872861960692352:0@lo:400:kworker.0 00000100:00100000:0.0:1786100689.829667:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786100679/real 1786100679] req@ffff9a3b42517100 x1872861960688896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786100689 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100689.829686:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a3b42517100 x1872861960688896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786100689 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100689.829696:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786100679/real 1786100679] req@ffff9a3c50d8bb80 x1872861960688768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786100689 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100689.829707:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a3c50d8bb80 x1872861960688768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786100689 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786100689.829719:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c60f67000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786100689.829734:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1786100689.829738:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960688896:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1786100689.829743:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c7cea7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786100689.829747:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1786100689.829750:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960688768:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1786100689.829797:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786100689.829801:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1786100689.829803:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a3c7cea7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786100689.829808:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:2.0:1786100689.829812:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786100689.829816:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a3c7cea7800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:2.0:1786100689.829836:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3c473d3480 x1872861960692608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786100689.829854:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786100689.829858:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1786100689.829859:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a3c60f67000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786100689.829862:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:2.0:1786100689.829864:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786100689.829867:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a3c60f67000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:2.0:1786100689.829876:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3c473d0380 x1872861960692736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786100689.829918:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960692608:0@lo:8:kworker.0 00000400:00000100:0.0:1786100689.829944:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872861960692608 offset 0 length 520: 4 00000100:00100000:0.0:1786100689.829964:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960692736:0@lo:8:kworker.0 00000400:00000100:0.0:1786100689.829977:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872861960692736 offset 0 length 520: 4 00010000:00010000:3.0:1786100690.347666:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100691.368490:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786100691.819327:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1786100692.144986:0:15008:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1786100692.144990:0:15008:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1786100692.145101:0:15008:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a3c7cea3000 00000020:01000004:1.0:1786100692.145115:0:15008:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1786100692.145127:0:15008:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1786100692.145156:0:15008:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a3c75fc4d40) 00000020:00000080:1.0:1786100692.145176:0:15008:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1786100692.172264:0:15008:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786100692.172732:0:15008:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1786100692.173625:0:15008:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786100692.173963:0:15008:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1786100692.174177:0:15008:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1786100692.174781:0:15008:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1786100692.174926:0:15008:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1786100692.175024:0:15008:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1786100692.177184:0:15008:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1786100692.177464:0:15008:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:3.0:1786100692.177934:0:15008:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1786100692.178173:0:15008:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1786100692.178430:0:15008:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1786100692.179234:0:15008:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:3.0:1786100692.181910:0:15008:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1786100692.181927:0:15008:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786100692.182002:0:15008:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5564f2c20ac1e6d 00000020:01000004:3.0:1786100692.182012:0:15008:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1786100692.182035:0:15008:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1786100692.182038:0:15008:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1786100692.182045:0:15008:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1786100692.182050:0:15008:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1786100692.182065:0:15008:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a3c7c01b380) 00000020:00000080:3.0:1786100692.182077:0:15008:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1786100692.185608:0:15008:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786100692.186164:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1786100692.186171:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1786100692.193340:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1786100692.193352:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1786100692.196589:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1786100692.205520:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1786100692.207752:0:15008:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786100692.207922:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1786100692.207929:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1786100692.211979:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1786100692.211996:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1786100692.247440:0:15008:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786100692.247728:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1786100692.247738:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1786100692.252094:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1786100692.252111:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1786100692.253199:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1786100692.253209:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1786100692.257738:0:15008:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786100692.257972:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1786100692.257980:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1786100692.260554:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1786100692.260567:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1786100692.295340:0:15008:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786100692.295592:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1786100692.295598:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1786100692.297409:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1786100692.297421:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1786100692.300865:0:15008:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1786100692.300899:0:15008:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1786100692.300904:0:15008:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1786100692.324613:0:15008:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786100692.324828:0:15008:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.153@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1786100692.324833:0:15008:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786100692.324835:0:15008:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786100692.324836:0:15008:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786100692.324838:0:15008:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786100692.324839:0:15008:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786100692.324840:0:15008:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786100692.324842:0:15008:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786100692.324843:0:15008:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786100692.324844:0:15008:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786100692.324848:0:15008:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1786100692.324850:0:15008:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786100692.324851:0:15008:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786100692.324852:0:15008:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786100692.324853:0:15008:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786100692.324854:0:15008:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786100692.324855:0:15008:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786100692.324856:0:15008:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786100692.324857:0:15008:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786100692.324858:0:15008:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786100692.324894:0:15008:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1786100692.324911:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960692864:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786100692.325060:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100692.325105:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583d4600 going to sleep for 11 seconds 00000100:00100000:3.0:1786100692.325218:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960692864 00000100:00100000:3.0:1786100692.325225:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960692864 00000100:00100000:3.0:1786100692.325270:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786100692.325278:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+12:15008:x1872861960692864:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1786100692.325320:0:14324:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1786100692.325323:0:14324:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1786100692.325326:0:14324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1786100692.341954:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+12:15008:x1872861960692864:12345-0@lo:253:mount.lustre.0 Request processed in 16668us (16886us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100692.341968:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786100692.342072:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960692864:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786100692.342103:0:15008:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1786100692.342107:0:15008:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786100692.342108:0:15008:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786100692.342110:0:15008:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786100692.342111:0:15008:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786100692.342113:0:15008:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786100692.342114:0:15008:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786100692.342116:0:15008:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786100692.342117:0:15008:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786100692.342119:0:15008:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1786100692.342140:0:15008:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a3c7cea3000 from lustre-OST0000 10000000:01000000:0.0:1786100692.342164:0:15008:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1786100692.342167:0:15008:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1786100692.342173:0:15008:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a3c7f4f19c0 local copy 00010000:00010000:0.0:1786100692.342182:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98e00/0x5564f2c20ac1d63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d6a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100692.342376:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960692992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786100692.342424:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100692.342470:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c60253c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786100692.342585:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960692992 00000100:00100000:2.0:1786100692.342590:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960692992 00000100:00100000:2.0:1786100692.342629:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786100692.342638:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+12:15008:x1872861960692992:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786100692.342809:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+12:15008:x1872861960692992:12345-0@lo:501:mount.lustre.0 Request processed in 172us (384us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786100692.342822:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786100692.342962:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960692992:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1786100692.342980:0:15008:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1786100692.343157:0:15008:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1786100692.343164:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98e00/0x5564f2c20ac1d63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d6a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.343174:0:15008:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98e00/0x5564f2c20ac1d63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d6a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100692.343196:0:15008:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a3c7cea3000 10000000:01000000:1.0:1786100692.343201:0:15008:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1786100692.343205:0:15008:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a3c7f4f19c0 10000000:01000000:1.0:1786100692.343207:0:15008:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1786100692.343210:0:15008:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a3c7f4f19c0 from 1 10000000:01000000:1.0:1786100692.343213:0:15008:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1786100692.343237:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac1e7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.343246:0:15008:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac1e7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.343256:0:15008:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac1e7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100692.343272:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786100692.343304:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100692.343335:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c43df4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786100692.343431:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960693120 00000100:00100000:2.0:1786100692.343436:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960693120 00000100:00100000:2.0:1786100692.343536:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786100692.343544:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+12:15008:x1872861960693120:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786100692.343554:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100692.343567:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7f51f200/0x5564f2c20ac1e82 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1e7b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100692.343588:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7f51f200/0x5564f2c20ac1e82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1e7b expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100692.343597:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7f51f200/0x5564f2c20ac1e82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1e7b expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100692.343605:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f200, rc 0) 00000100:00100000:2.0:1786100692.343677:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+13:15008:x1872861960693120:12345-0@lo:101:mount.lustre.0 Request processed in 133us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100692.343683:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786100692.343691:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786100692.343714:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac1e7b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e82 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.343723:0:15008:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac1e7b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1e82 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100692.343739:0:15008:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1786100692.343758:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac1e7b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e82 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.343766:0:15008:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e600/0x5564f2c20ac1e7b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e82 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100692.343773:0:15008:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1786100692.343777:0:15008:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786100692.343781:0:15008:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1786100692.343783:0:15008:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1786100692.343797:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac1e89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.343804:0:15008:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac1e89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.343811:0:15008:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac1e89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100692.343824:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786100692.343854:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100692.343884:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c43df4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786100692.343902:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960693248 00000100:00100000:0.0:1786100692.343908:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960693248 00000100:00100000:0.0:1786100692.343939:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786100692.343946:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+13:15008:x1872861960693248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786100692.343953:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100692.343961:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbae00/0x5564f2c20ac1e90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1e89 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100692.343976:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbae00/0x5564f2c20ac1e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1e89 expref: 14 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100692.343983:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbbae00/0x5564f2c20ac1e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1e89 expref: 14 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100692.343996:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbae00, rc 0) 00000100:00100000:0.0:1786100692.344033:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+14:15008:x1872861960693248:12345-0@lo:101:mount.lustre.0 Request processed in 88us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100692.344040:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786100692.344382:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693248:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786100692.344404:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac1e89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e90 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.344420:0:15008:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac1e89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1e90 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786100692.345914:0:15008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1786100692.348019:0:15008:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786100692.348335:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1786100692.348998:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1786100692.349047:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1786100692.349105:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1786100692.349146:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1786100692.349184:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1786100692.349263:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1786100692.349272:0:15008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1786100692.349358:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786100692.350055:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100692.350103:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c493f79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100692.350219:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960693376 00000100:00100000:0.0:1786100692.350228:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960693376 00000100:00100000:0.0:1786100692.350285:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1786100692.350294:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+14:15008:x1872861960693376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786100692.350697:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+14:15008:x1872861960693376:12345-0@lo:501:mount.lustre.0 Request processed in 402us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100692.350705:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786100692.350779:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786100692.350817:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693504:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786100692.350855:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100692.350883:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c493f79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100692.350900:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960693504 00000100:00100000:2.0:1786100692.350905:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960693504 00000100:00100000:2.0:1786100692.350936:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786100692.350943:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+14:15008:x1872861960693504:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786100692.351840:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+14:15008:x1872861960693504:12345-0@lo:503:mount.lustre.0 Request processed in 893us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100692.351848:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786100692.351912:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693504:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1786100692.352483:0:15008:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786100692.352544:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786100692.352598:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100692.352836:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100692.355348:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960693632 00000100:00100000:2.0:1786100692.355361:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960693632 00000100:00100000:3.0:1786100692.355561:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1786100692.355573:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+14:15008:x1872861960693632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786100692.355889:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+14:15008:x1872861960693632:12345-0@lo:502:mount.lustre.0 Request processed in 318us (3289us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100692.355898:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786100692.355999:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786100692.356269:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1786100692.356332:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1786100692.356370:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1786100692.356435:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1786100692.356477:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1786100692.356514:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1786100692.356561:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1786100692.356612:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1786100692.356642:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1786100692.356716:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1786100692.356750:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1786100692.356805:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1786100692.356839:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786100692.356884:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100692.357215:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c74b67cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100692.357265:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960693760 00000100:00100000:0.0:1786100692.357271:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960693760 00000100:00100000:0.0:1786100692.357303:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786100692.357312:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+14:15008:x1872861960693760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786100692.357503:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+14:15008:x1872861960693760:12345-0@lo:502:mount.lustre.0 Request processed in 191us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100692.357510:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786100692.357597:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786100692.357776:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1786100692.357787:0:15008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1786100692.359940:0:15022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786100692.359950:0:15022:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1786100692.359958:0:15022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100692.359960:0:15022:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1786100692.359969:0:15022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786100692.359983:0:15022:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a3c44f34d40) 00000020:00000080:0.0:1786100692.360003:0:15022:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1786100692.360009:0:15022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1786100692.360084:0:15022:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a3c7cea3000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1786100692.360091:0:15022:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1786100692.360098:0:15022:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5564f2c20ac1e9e 00010000:00010000:0.0:1786100692.364093:0:15022:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1786100692.364555:0:15022:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1786100692.370922:0:15022:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1786100692.374398:0:15022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1786100692.374412:0:15022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100692.374419:0:15022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100692.374428:0:15022:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1786100692.374436:0:15022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1786100692.374438:0:15022:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1786100692.374440:0:15022:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786100692.374441:0:15022:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786100692.374443:0:15022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1786100692.374446:0:15022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100692.374447:0:15022:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1786100692.374450:0:15022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786100692.374464:0:15022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100692.374466:0:15022:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786100692.374470:0:15022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786100692.374471:0:15022:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1786100692.374474:0:15022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100692.374476:0:15022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100692.374478:0:15022:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1786100692.374480:0:15022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786100692.374482:0:15022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100692.374484:0:15022:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1786100692.374487:0:15022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1786100692.374550:0:15022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100692.374554:0:15022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100692.374556:0:15022:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1786100692.374560:0:15022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1786100692.376872:0:15008:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1786100692.376916:0:15008:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1786100692.376938:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac1e89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e90 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.376951:0:15008:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4165e400/0x5564f2c20ac1e89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1e90 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100692.376967:0:15008:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c7cea3000 from 1 10000000:01000000:1.0:1786100692.376969:0:15008:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786100692.377004:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.377012:0:15008:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.377022:0:15008:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100692.377046:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786100692.377107:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100692.377142:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c493f79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100692.377241:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960693888 00000100:00100000:3.0:1786100692.377248:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960693888 00000100:00100000:3.0:1786100692.377299:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1786100692.377308:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+14:15008:x1872861960693888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786100692.377322:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100692.377334:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa99200/0x5564f2c20ac1eac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1ea5 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.377357:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa99200/0x5564f2c20ac1eac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1ea5 expref: 15 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.377366:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa99200/0x5564f2c20ac1eac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1ea5 expref: 15 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.377374:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99200, rc 0) 00000100:00100000:3.0:1786100692.377476:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+15:15008:x1872861960693888:12345-0@lo:101:mount.lustre.0 Request processed in 168us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100692.377483:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786100692.379577:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960693888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786100692.379600:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1eac expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.379611:0:15008:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1eac expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786100692.380335:0:15008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1786100692.383830:0:15008:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786100692.384173:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1786100692.384221:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1786100692.384291:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1786100692.384301:0:15008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1786100692.384381:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786100692.384460:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100692.384934:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c493f79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100692.387582:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960694016 00000100:00100000:2.0:1786100692.387595:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960694016 00000100:00100000:2.0:1786100692.387641:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786100692.387673:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+15:15008:x1872861960694016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786100692.388176:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+15:15008:x1872861960694016:12345-0@lo:501:mount.lustre.0 Request processed in 524us (3714us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100692.388184:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1786100692.391420:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786100692.391484:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786100692.391562:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100692.391606:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c493f79c0 going to sleep for 11 seconds 00010000:00010000:3.0:1786100692.391630:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100692.391762:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960694144 00000100:00100000:1.0:1786100692.391768:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960694144 00000100:00100000:1.0:1786100692.391808:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1786100692.391817:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+15:15008:x1872861960694144:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786100692.392146:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+15:15008:x1872861960694144:12345-0@lo:503:mount.lustre.0 Request processed in 329us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100692.392154:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786100692.392239:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694144:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1786100692.392891:0:15008:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786100692.393028:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786100692.393134:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100692.393164:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583d4840 going to sleep for 11 seconds 00000100:00100000:3.0:1786100692.395239:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960694272 00000100:00100000:3.0:1786100692.395250:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960694272 00000100:00100000:3.0:1786100692.395292:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786100692.395302:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+15:15008:x1872861960694272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786100692.396186:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+15:15008:x1872861960694272:12345-0@lo:502:mount.lustre.0 Request processed in 882us (3047us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100692.396196:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1786100692.396448:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1786100692.396793:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1786100692.396852:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1786100692.396896:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1786100692.397019:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1786100692.397128:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1786100692.397181:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1786100692.397216:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1786100692.397259:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1786100692.397294:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786100692.397343:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100692.397381:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583d4840 going to sleep for 11 seconds 00000100:00100000:1.0:1786100692.397432:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960694400 00000100:00100000:1.0:1786100692.397441:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960694400 00000100:00100000:1.0:1786100692.397490:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786100692.397498:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+15:15008:x1872861960694400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786100692.397741:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+15:15008:x1872861960694400:12345-0@lo:502:mount.lustre.0 Request processed in 243us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100692.397749:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786100692.397832:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786100692.397913:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1786100692.397923:0:15008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1786100692.399057:0:15027:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100692.399069:0:15027:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100692.399072:0:15027:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1786100692.399079:0:15027:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a3c7cea3000 00000020:00000080:0.0:1786100692.399081:0:15027:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786100692.399088:0:15027:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100692.399090:0:15027:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100692.399092:0:15027:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1786100692.399094:0:15027:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100692.399096:0:15027:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100692.399098:0:15027:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1786100692.399101:0:15027:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a3c7cea3000 00000020:00000080:0.0:1786100692.399103:0:15027:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786100692.399159:0:15027:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100692.399163:0:15027:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100692.399165:0:15027:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1786100692.399168:0:15027:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100692.399170:0:15027:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100692.399172:0:15027:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1786100692.399175:0:15027:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a3c7cea3000 00000020:00000080:0.0:1786100692.399177:0:15027:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786100692.399210:0:15027:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100692.399213:0:15027:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100692.399214:0:15027:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1786100692.399223:0:15027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1786100692.405387:0:15008:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1786100692.405433:0:15008:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786100692.405458:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1eac expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.405480:0:15008:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1eac expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100692.405526:0:15008:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1786100692.405528:0:15008:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a3c7cea3000 10000000:01000000:3.0:1786100692.405531:0:15008:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a3c7cea3000 10000000:01000000:3.0:1786100692.405535:0:15008:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786100692.405540:0:15008:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a3c7cea3000 from 1 10000000:01000000:3.0:1786100692.405542:0:15008:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786100692.405577:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99000/0x5564f2c20ac1eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.405585:0:15008:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99000/0x5564f2c20ac1eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.405596:0:15008:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99000/0x5564f2c20ac1eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100692.405631:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786100692.405720:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100692.405757:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960694528 00000100:00100000:3.0:1786100692.405763:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960694528 00000100:00100000:3.0:1786100692.405803:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1786100692.405811:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+15:15008:x1872861960694528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786100692.405823:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100692.405841:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa98c00/0x5564f2c20ac1eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1eb3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.405872:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa98c00/0x5564f2c20ac1eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1eb3 expref: 16 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.405882:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa98c00/0x5564f2c20ac1eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1eb3 expref: 16 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.405890:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98c00, rc 0) 00000100:00100000:3.0:1786100692.405922:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+16:15008:x1872861960694528:12345-0@lo:101:mount.lustre.0 Request processed in 111us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100692.405928:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1786100692.405971:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734000 going to sleep for 11 seconds 00000100:00100000:3.0:1786100692.405993:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786100692.406006:0:15008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99000/0x5564f2c20ac1eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1eba expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.406015:0:15008:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99000/0x5564f2c20ac1eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1eba expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786100692.406573:0:15008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1786100692.407069:0:15008:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786100692.407305:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1786100692.407341:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1786100692.407366:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1786100692.407422:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1786100692.407455:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1786100692.407498:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1786100692.407529:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1786100692.407554:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1786100692.407601:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1786100692.407632:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1786100692.407684:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1786100692.407724:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1786100692.407765:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1786100692.407795:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1786100692.407835:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1786100692.407861:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1786100692.407887:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1786100692.407922:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1786100692.407950:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1786100692.407980:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1786100692.408016:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1786100692.408043:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1786100692.408073:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1786100692.408122:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1786100692.408157:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1786100692.413729:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1786100692.413857:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1786100692.413894:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1786100692.413999:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1786100692.414007:0:15008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1786100692.414147:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786100692.414211:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100692.414253:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734000 going to sleep for 11 seconds 00000100:00100000:1.0:1786100692.414335:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960694656 00000100:00100000:1.0:1786100692.414342:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960694656 00000100:00100000:1.0:1786100692.414398:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786100692.414409:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+16:15008:x1872861960694656:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786100692.414617:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+16:15008:x1872861960694656:12345-0@lo:501:mount.lustre.0 Request processed in 208us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100692.414630:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1786100692.414737:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786100692.414768:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786100692.414802:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100692.419171:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734000 going to sleep for 11 seconds 00000100:00100000:1.0:1786100692.419265:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960694784 00000100:00100000:1.0:1786100692.419274:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960694784 00000100:00100000:1.0:1786100692.419329:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1786100692.419339:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+16:15008:x1872861960694784:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786100692.419551:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+16:15008:x1872861960694784:12345-0@lo:503:mount.lustre.0 Request processed in 212us (4746us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100692.419559:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786100692.419683:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694784:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1786100692.420296:0:15008:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786100692.420369:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786100692.420450:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100692.420490:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960694912 00000100:00100000:3.0:1786100692.420495:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960694912 00000100:00100000:3.0:1786100692.420528:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1786100692.420536:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+16:15008:x1872861960694912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786100692.420729:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+16:15008:x1872861960694912:12345-0@lo:502:mount.lustre.0 Request processed in 193us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100692.420737:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1786100692.420774:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734000 going to sleep for 11 seconds 00000100:00100000:3.0:1786100692.420788:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960694912:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786100692.421001:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1786100692.421044:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1786100692.421076:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1786100692.421122:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1786100692.421158:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1786100692.421213:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1786100692.421248:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1786100692.421278:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1786100692.421322:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1786100692.421355:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1786100692.421387:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1786100692.421449:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1786100692.421494:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1786100692.421524:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1786100692.421568:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1786100692.421601:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1786100692.421644:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1786100692.421721:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1786100692.421757:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1786100692.421789:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1786100692.421840:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1786100692.421877:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1786100692.421907:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1786100692.421951:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1786100692.421987:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1786100692.422019:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1786100692.422063:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1786100692.422099:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1786100692.422147:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1786100692.422191:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1786100692.422222:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1786100692.422252:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1786100692.422282:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1786100692.422323:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1786100692.422357:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1786100692.422426:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1786100692.432006:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1786100692.432099:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1786100692.432175:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1786100692.432209:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1786100692.432255:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960695040:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786100692.432329:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100692.432365:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960695040 00000100:00100000:3.0:1786100692.432372:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960695040 00000100:00100000:3.0:1786100692.432425:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786100692.432434:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+16:15008:x1872861960695040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786100692.432624:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+16:15008:x1872861960695040:12345-0@lo:502:mount.lustre.0 Request processed in 190us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100692.432639:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786100692.432720:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734000 going to sleep for 11 seconds 00000100:00100000:3.0:1786100692.432742:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960695040:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786100692.432808:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1786100692.432822:0:15008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1786100692.443862:0:15032:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1786100692.443879:0:15032:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a3c7c018000) 00000020:00000080:3.0:1786100692.443904:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1786100692.444060:0:15032:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a3c7cea3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786100692.444064:0:15032:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a3c7cea3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786100692.444067:0:15032:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a3c7cea3000 3 00010000:00080000:3.0:1786100692.444096:0:15032:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a3c60c88800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.153@tcp at head 00010000:00010000:3.0:1786100692.452120:0:15032:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1786100692.452236:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1786100692.452270:0:15032:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786100692.452281:0:15032:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5564f2c20ac1ec8 00000100:00080000:3.0:1786100692.452291:0:15032:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786100692.452296:0:15032:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a3c60c88800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:3.0:1786100692.452328:0:15032:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3b42516d80 x1872861960695168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786100692.452355:0:15032:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1786100692.452502:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1872861960695168:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786100692.452566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100692.452634:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960695168 00000100:00100000:0.0:1786100692.452642:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960695168 00000100:00100000:0.0:1786100692.452690:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786100692.452697:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1872861960695168:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1786100692.452719:0:14328:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:0.0:1786100692.452750:0:14328:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5564f2c20ac1ecf 00000004:00100000:0.0:1786100692.452765:0:14328:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786100692.452795:0:14328:0:(import.c:65:import_set_state_nolock()) ffff9a3b42762800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786100692.452844:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1872861960695168:12345-0@lo:38:llog_process_th.0 Request processed in 146us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100692.452852:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1786100692.452888:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3b42516d80 x1872861960695168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786100702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786100692.452898:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786100692.452905:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1786100692.452911:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1786100692.452916:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786100692.452918:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c60c88800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786100692.452925:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1872861960695168:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1786100692.455122:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1786100692.455326:0:15008:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1786100692.455351:0:15008:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786100692.455371:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99000/0x5564f2c20ac1eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1eba expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.455382:0:15008:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99000/0x5564f2c20ac1eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1eba expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786100692.455432:0:15008:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786100692.455434:0:15008:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786100692.455435:0:15008:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786100692.455436:0:15008:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786100692.455437:0:15008:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786100692.455439:0:15008:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786100692.455440:0:15008:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786100692.455442:0:15008:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786100692.455443:0:15008:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786100692.455447:0:15008:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1786100692.455449:0:15008:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786100692.455450:0:15008:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786100692.455451:0:15008:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786100692.455452:0:15008:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786100692.455453:0:15008:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786100692.455459:0:15008:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786100692.455459:0:15008:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786100692.455460:0:15008:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786100692.455461:0:15008:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786100692.455484:0:15008:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1786100692.455501:0:15008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960695296:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1786100692.455557:0:15008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100692.455674:0:15008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3b423236c0 going to sleep for 11 seconds 00000100:00080000:2.0:1786100692.455788:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786100692.455793:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1786100692.455796:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786100692.455798:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1786100692.455856:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786100692.455866:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960695424:0@lo:400:kworker.0 00000100:00100000:2.0:1786100692.455898:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100692.455934:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960695424 00000100:00100000:2.0:1786100692.455941:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960695424 00000100:00100000:2.0:1786100692.455979:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786100692.455996:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960695424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100692.456045:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960695424:12345-0@lo:400:kworker.0 Request processed in 51us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100692.456053:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1786100692.456090:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c473d3800 x1872861960695424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100692.456104:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960695424:0@lo:400:kworker.0 00000100:00100000:3.0:1786100692.456266:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960695296 00000100:00100000:3.0:1786100692.456270:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960695296 00000100:00100000:3.0:1786100692.456335:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786100692.456343:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+16:15008:x1872861960695296:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1786100692.456363:0:14324:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1786100692.456376:0:14324:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1786100692.480073:0:14324:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1786100692.480094:0:14324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1786100692.480992:0:14344:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1786100692.480998:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1786100692.481018:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.481036:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac1e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1e3c expref: 16 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.481044:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.481083:0:14344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac1e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac1e3c expref: 16 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100692.481097:0:14344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac1e43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac1e3c expref: 16 pid: 14324 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100692.481112:0:14344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42517b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14344:1872861960695552:0@lo:104: 00000100:00100000:3.0:1786100692.481174:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100692.481216:0:14344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786100692.481300:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960695552 00000100:00100000:1.0:1786100692.481308:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960695552 00000100:00100000:1.0:1786100692.481358:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786100692.481367:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0af484e0-17d7-4fef-8244-23d93563e204+3:14344:x1872861960695552:12345-0@lo:104: 00010000:00010000:1.0:1786100692.481380:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1e43 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.481445:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786100692.481451:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0af484e0-17d7-4fef-8244-23d93563e204+3:14344:x1872861960695552:12345-0@lo:104: Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100692.481458:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786100692.481494:0:14344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42517b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14344:1872861960695552:0@lo:104: 00010000:00010000:1.0:1786100692.481511:0:14344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100692.483461:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100692.483472:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1e43 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100692.483500:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fc00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100692.483505:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac1e43 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100692.483514:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac1e43 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100692.483521:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac1e43 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100692.483526:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1786100692.483568:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1e43 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100692.483575:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100692.483604:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1e43 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100692.483611:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4165fc00/0x5564f2c20ac1e3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1e43 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100692.484501:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100692.484504:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100692.484505:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100692.486130:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0af484e0-17d7-4fef-8244-23d93563e204:3305:1872861960695680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786100692.486198:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100692.486358:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960695680 00000100:00100000:0.0:1786100692.486367:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960695680 00010000:00010000:0.0:1786100692.486408:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac1e43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1e3c expref: 17 pid: 14324 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100692.486473:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786100692.486483:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0af484e0-17d7-4fef-8244-23d93563e204+17:3305:x1872861960695680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786100692.486563:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100692.486571:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac1e43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1e3c expref: 17 pid: 14324 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.486583:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac1e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac1e3c expref: 17 pid: 14324 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.486600:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa98000/0x5564f2c20ac1e43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac1e3c expref: 17 pid: 14324 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.486615:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.486624:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786100692.486639:0:14315:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005642271s 00010000:00010000:1.0:1786100692.486643:0:14315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.486670:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.486677:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.486682:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.486688:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100692.486692:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.486706:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.486724:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100692.486735:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100692.486770:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0af484e0-17d7-4fef-8244-23d93563e204+16:3305:x1872861960695680:12345-0@lo:103:ldlm_bl.0 Request processed in 288us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100692.486777:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786100692.486834:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0af484e0-17d7-4fef-8244-23d93563e204:3305:1872861960695680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786100692.486904:0:14344:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100692.486923:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100692.486929:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa99600/0x5564f2c20ac1ed6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100692.488385:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+15:15008:x1872861960695296:12345-0@lo:253:mount.lustre.0 Request processed in 32037us (32821us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100692.488459:0:15008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15008:1872861960695296:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1786100692.488474:0:15008:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1786100692.488477:0:15008:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786100692.488478:0:15008:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786100692.488479:0:15008:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786100692.488480:0:15008:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786100692.488482:0:15008:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786100692.488483:0:15008:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786100692.488484:0:15008:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786100692.488486:0:15008:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786100692.488488:0:15008:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786100692.488498:0:15008:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1786100692.488594:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00080000:10000000:1.0:1786100692.493614:0:15008:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1786100692.493840:0:15008:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1786100692.494000:0:15008:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1786100692.494190:0:15008:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1786100692.494370:0:15008:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1786100692.494611:0:15008:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1786100692.496148:0:15008:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1786100692.537188:0:15008:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1786100692.537199:0:15008:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1786100692.537228:0:15008:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1786100692.537284:0:15008:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1786100692.537299:0:15008:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1786100692.537324:0:15008:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1786100693.414764:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1786100694.052785:0:14326:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1786100694.052792:0:14326:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a3b42967000 from 7 10000000:01000000:1.0:1786100694.052797:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786100694.052845:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100694.052857:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100694.052869:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100694.052897:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960695808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786100694.052963:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100694.053022:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f598a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786100694.053088:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960695808 00000100:00100000:3.0:1786100694.053104:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960695808 00000100:00100000:3.0:1786100694.053183:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1786100694.053194:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+15:14326:x1872861960695808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100694.053215:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100694.053238:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa98200/0x5564f2c20ac1ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1edd expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100694.053269:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa98200/0x5564f2c20ac1ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1edd expref: 16 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100694.053305:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa98200/0x5564f2c20ac1ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1edd expref: 16 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100694.053315:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98200, rc 0) 00000100:00100000:3.0:1786100694.053524:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+16:14326:x1872861960695808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 331us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100694.053532:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786100694.055047:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960695808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786100694.055080:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1ee4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100694.055092:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1ee4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100694.055185:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960695936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1786100694.055264:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100694.055313:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7f598a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786100694.055364:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960695936 00000100:00100000:0.0:1786100694.055378:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960695936 00000100:00100000:0.0:1786100694.055455:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1786100694.055465:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+16:14326:x1872861960695936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786100694.055490:0:14324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786100694.055511:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786100694.055514:0:14324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1786100694.055686:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+16:14326:x1872861960695936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 220us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100694.055695:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1786100694.055881:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960695936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1786100694.055954:0:14326:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786100694.055963:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1ee4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100694.055974:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1ee4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100694.439173:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100695.460899:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100696.485831:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786100697.510224:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786100697.510230:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1786100697.510246:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786100697.510256:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1786100697.510299:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0af484e0-17d7-4fef-8244-23d93563e204:3306:1872861960696064:0@lo:400:kworker.0 00000100:00100000:1.0:1786100697.510371:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100697.510438:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960696192:0@lo:400:kworker.0 00000100:00100000:1.0:1786100697.510464:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100697.510483:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786100697.510488:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960696320:0@lo:400:kworker.0 00000100:00100000:1.0:1786100697.510513:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100697.510543:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960696064 00000100:00100000:1.0:1786100697.510549:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960696064 00000100:00100000:1.0:1786100697.510587:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1786100697.510596:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+16:3306:x1872861960696064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100697.510640:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+16:3306:x1872861960696064:12345-0@lo:400:kworker.0 Request processed in 45us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100697.510646:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1786100697.510695:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960696192 00000100:00100000:1.0:1786100697.510699:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960696192 00000100:00100000:1.0:1786100697.510722:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960696320 00000100:00100000:1.0:1786100697.510725:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960696320 00000100:00100000:1.0:1786100697.510752:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786100697.510759:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960696192:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786100697.510780:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100697.510793:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960696192:12345-0@lo:400:kworker.0 Request processed in 34us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100697.510799:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786100697.510810:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786100697.510816:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960696320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100697.510851:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960696320:12345-0@lo:400:kworker.0 Request processed in 35us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100697.510857:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1786100697.510893:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c7c10d500 x1872861960696320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100697.510907:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960696320:0@lo:400:kworker.0 00010000:00080000:1.0:1786100697.510917:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3c7c10d180 x1872861960696192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100697.510924:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960696192:0@lo:400:kworker.0 00000100:00100000:1.0:1786100697.510948:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0af484e0-17d7-4fef-8244-23d93563e204:3306:1872861960696064:0@lo:400:kworker.0 00010000:00010000:0.0:1786100697.511542:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100698.533964:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786100698.569198:0:15374:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1786100699.561323:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100700.585309:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786100701.032504:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1786100701.607934:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100702.630545:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786100702.637787:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786100702.637796:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1786100702.637800:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786100702.637803:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1786100702.637826:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0af484e0-17d7-4fef-8244-23d93563e204:3305:1872861960696448:0@lo:400:kworker.0 00000100:00100000:3.0:1786100702.637913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100702.638001:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960696448 00000100:00100000:3.0:1786100702.638010:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960696448 00000100:00100000:3.0:1786100702.638067:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1786100702.638076:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+16:3305:x1872861960696448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100702.638135:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+16:3305:x1872861960696448:12345-0@lo:400:kworker.0 Request processed in 59us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100702.638142:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1786100702.638201:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0af484e0-17d7-4fef-8244-23d93563e204:3305:1872861960696448:0@lo:400:kworker.0 00000100:00100000:3.0:1786100702.638241:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960696576:0@lo:400:kworker.0 00000100:00100000:3.0:1786100702.638297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100702.638343:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960696576 00000100:00100000:3.0:1786100702.638347:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960696576 00000100:00100000:3.0:1786100702.638378:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786100702.638385:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960696576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100702.638421:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960696576:12345-0@lo:400:kworker.0 Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100702.638427:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1786100702.638454:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3b42516a00 x1872861960696576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100702.638466:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960696576:0@lo:400:kworker.0 00000100:00100000:3.0:1786100702.638504:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960696704:0@lo:400:kworker.0 00000100:00100000:3.0:1786100702.638534:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100702.638570:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960696704 00000100:00100000:3.0:1786100702.638574:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960696704 00000100:00100000:3.0:1786100702.638606:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786100702.638612:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960696704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100702.638645:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960696704:12345-0@lo:400:kworker.0 Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100702.638833:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1786100702.638851:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786100702.638873:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3b42516a00 x1872861960696704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100702.638884:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960696704:0@lo:400:kworker.0 00010000:00010000:0.0:1786100703.655895:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.680557:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100704.748888:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786100689/real 1786100689] req@ffff9a3c473d3480 x1872861960692608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786100704 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100704.748928:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a3c473d3480 x1872861960692608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786100704 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100704.748941:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786100689/real 1786100689] req@ffff9a3c473d0380 x1872861960692736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786100704 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100704.748953:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a3c473d0380 x1872861960692736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786100704 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786100704.748976:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c7cea7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786100704.749055:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1786100704.749059:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960692608:0@lo:8:kworker.0 00000100:00080000:1.0:1786100704.749080:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c60f67000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786100704.749797:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786100704.749809:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1786100704.749813:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a3c7cea7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786100704.749820:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:3.0:1786100704.749827:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1786100704.749835:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a3c7cea7800 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:3.0:1786100704.749863:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3b42515f80 x1872861960696960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786100704.749876:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786100704.749879:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1786100704.749881:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a3c60f67000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786100704.749884:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:3.0:1786100704.749887:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1786100704.749891:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a3c60f67000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:3.0:1786100704.749902:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3b42516680 x1872861960697088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786100704.749961:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960696832:0@lo:400:kworker.0 00000100:00100000:3.0:1786100704.751095:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100704.751275:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960697216:0@lo:400:kworker.0 00000100:00100000:3.0:1786100704.751337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100704.751363:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786100704.751371:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960697344:0@lo:400:kworker.0 00000100:00100000:3.0:1786100704.751397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100704.751510:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960697216 00000100:00100000:3.0:1786100704.751519:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960697216 00000100:00100000:3.0:1786100704.751572:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960697344 00000100:00100000:3.0:1786100704.751585:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960697344 00000100:00100000:3.0:1786100704.751621:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786100704.751630:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960697216:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1786100704.751855:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1786100704.751863:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960692736:0@lo:8:kworker.0 00000100:00100000:1.0:1786100704.751892:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960696960:0@lo:8:kworker.0 00000100:00100000:1.0:1786100704.751932:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100704.751962:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960697088:0@lo:8:kworker.0 00000100:00100000:1.0:1786100704.751992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100704.752115:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960696960 00000100:00100000:1.0:1786100704.752187:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960696960 00000100:00100000:1.0:1786100704.752210:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960697088 00000100:00100000:1.0:1786100704.752213:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960697088 00000100:00100000:1.0:1786100704.752225:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786100704.752230:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1872861960696960:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1786100704.752258:0:15010:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:1.0:1786100704.752291:0:15010:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5564f2c20ac1eeb 00002000:00100000:1.0:1786100704.752308:0:15010:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a3c7bf10800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1786100704.752313:0:15010:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1786100704.752316:0:15010:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1786100704.752503:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960697216:12345-0@lo:400:kworker.0 Request processed in 871us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100704.752511:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786100704.752533:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786100704.752543:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960697344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100704.752580:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960697344:12345-0@lo:400:kworker.0 Request processed in 41us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100704.752587:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1786100704.752617:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786100704.752680:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3b42514e00 x1872861960697344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100704.752696:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960697344:0@lo:400:kworker.0 00010000:00080000:3.0:1786100704.752707:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3b42517480 x1872861960697216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100704.752716:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960697216:0@lo:400:kworker.0 00000100:00100000:2.0:1786100704.753239:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960696832 00000100:00100000:2.0:1786100704.753248:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960696832 00000100:00100000:2.0:1786100704.753296:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1786100704.753306:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+16:3308:x1872861960696832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100704.753372:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+16:3308:x1872861960696832:12345-0@lo:400:kworker.0 Request processed in 68us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100704.753380:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00002000:00080000:1.0:1786100704.753892:0:15010:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1786100704.753929:0:15010:0:(import.c:65:import_set_state_nolock()) ffff9a3c7bf14800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786100704.753990:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1872861960696960:12345-0@lo:8:kworker.0 Request processed in 1758us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100704.754000:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786100704.758754:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960696832:0@lo:400:kworker.0 00000100:00100000:2.0:1786100704.758912:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786100704.758923:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1872861960697088:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1786100704.758949:0:15011:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786100704.759061:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1872861960697088:12345-0@lo:8:kworker.0 Request processed in 137us (7066us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786100704.759068:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1786100704.759285:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3b42515f80 x1872861960696960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786100724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100704.759299:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786100704.759342:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1786100704.759354:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1786100704.759361:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1786100704.759365:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c7cea7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1786100704.759400:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000004:00080000:3.0:1786100704.759600:0:14351:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1786100704.759626:0:14351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42517480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14351:1872861960697600:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1786100704.759777:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960696960:0@lo:8:kworker.0 00000100:00080000:1.0:1786100704.759799:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c60f67000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786100704.759804:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786100704.759807:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960697088:0@lo:8:kworker.0 00000100:00100000:3.0:1786100704.760237:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100704.760280:0:14351:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583e4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786100704.760299:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960697472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100704.760357:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1786100704.760556:0:14350:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1786100704.760982:0:14350:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 446003330365ns, next at 0ns, rc = 0 00000100:00100000:3.0:1786100704.761331:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960697472 00000100:00100000:3.0:1786100704.761341:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960697472 00000100:00100000:3.0:1786100704.761785:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786100704.761800:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872861960697472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786100704.761844:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100704.761930:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872861960697472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100704.761937:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1786100704.761988:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a3b42516a00 x1872861960697472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100704.762011:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960697472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100704.762142:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960697600 00000100:00100000:0.0:1786100704.762148:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960697600 00000100:00100000:0.0:1786100704.762183:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786100704.762189:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14351:x1872861960697600:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1786100704.764842:0:15011:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1786100704.764856:0:15011:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1786100704.764862:0:15011:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00080000:2.0:1786100704.768035:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1786100704.801398:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786100704.801415:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e1daa42/0x5564f2c20ac1ef2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.801447:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1786100704.801453:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100704.802314:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e1daa42/0x5564f2c20ac1ef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.802353:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e1daa42/0x5564f2c20ac1ef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.802366:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e1daa42/0x5564f2c20ac1ef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.802375:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e1daa42/0x5564f2c20ac1ef2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.802409:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1786100704.804393:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786100704.804410:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ad8760b/0x5564f2c20ac1ef9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804429:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1786100704.804436:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100704.804444:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ad8760b/0x5564f2c20ac1ef9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804460:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ad8760b/0x5564f2c20ac1ef9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804486:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ad8760b/0x5564f2c20ac1ef9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804495:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ad8760b/0x5564f2c20ac1ef9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804532:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1786100704.804554:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786100704.804563:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e1daa42/0x5564f2c20ac1ef2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804572:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100704.804578:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e1daa42/0x5564f2c20ac1ef2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804588:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e1daa42/0x5564f2c20ac1ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804610:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e1daa42/0x5564f2c20ac1ef2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804618:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e1daa42/0x5564f2c20ac1ef2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804638:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100704.804825:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ad8760b/0x5564f2c20ac1ef9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804835:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100704.804838:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ad8760b/0x5564f2c20ac1ef9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804846:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ad8760b/0x5564f2c20ac1ef9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804857:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ad8760b/0x5564f2c20ac1ef9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804864:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ad8760b/0x5564f2c20ac1ef9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.804877:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.804879:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.804881:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100704.805647:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1786100704.806508:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786100704.806520:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089308799/0x5564f2c20ac1f00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.806538:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1786100704.806543:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100704.806550:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089308799/0x5564f2c20ac1f00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.806576:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089308799/0x5564f2c20ac1f00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.806586:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089308799/0x5564f2c20ac1f00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.806594:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089308799/0x5564f2c20ac1f00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.806627:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100704.806823:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100704.806832:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089308799/0x5564f2c20ac1f00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.806841:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb200 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100704.806846:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089308799/0x5564f2c20ac1f00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.806854:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089308799/0x5564f2c20ac1f00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.806875:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089308799/0x5564f2c20ac1f00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.806882:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089308799/0x5564f2c20ac1f00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.806913:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100704.806915:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100704.806917:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1786100704.807883:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786100704.807893:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006629f20/0x5564f2c20ac1f07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.807907:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1786100704.807912:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100704.807918:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006629f20/0x5564f2c20ac1f07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.807931:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006629f20/0x5564f2c20ac1f07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.807941:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006629f20/0x5564f2c20ac1f07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.807961:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006629f20/0x5564f2c20ac1f07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.807984:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1786100704.808576:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786100704.808584:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac1f0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.808596:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1786100704.808600:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100704.808604:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac1f0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.808613:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac1f0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.808623:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac1f0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.808630:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac1f0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.808901:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786100704.810834:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786100704.810852:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006629f20/0x5564f2c20ac1f07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.810871:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100704.810877:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006629f20/0x5564f2c20ac1f07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.810892:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006629f20/0x5564f2c20ac1f07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.810918:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006629f20/0x5564f2c20ac1f07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.810927:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006629f20/0x5564f2c20ac1f07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.811082:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100704.811087:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac1f0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.811094:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100704.811175:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac1f0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.811185:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac1f0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.811197:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac1f0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.811204:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac1f0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.811221:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.814070:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1786100704.815053:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786100704.815073:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4cdbadf/0x5564f2c20ac1f15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.815093:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1786100704.815238:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100704.815249:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4cdbadf/0x5564f2c20ac1f15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.815267:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4cdbadf/0x5564f2c20ac1f15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.815279:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4cdbadf/0x5564f2c20ac1f15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.815287:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4cdbadf/0x5564f2c20ac1f15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.815305:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786100704.815318:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100704.815338:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4cdbadf/0x5564f2c20ac1f15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.815346:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbaa00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100704.815351:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4cdbadf/0x5564f2c20ac1f15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.815361:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4cdbadf/0x5564f2c20ac1f15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.815389:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4cdbadf/0x5564f2c20ac1f15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.815397:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4cdbadf/0x5564f2c20ac1f15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.815418:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.815420:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.815422:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1786100704.816137:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786100704.816145:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000192d521a/0x5564f2c20ac1f1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.816157:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1786100704.816161:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100704.816166:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000192d521a/0x5564f2c20ac1f1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.816177:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000192d521a/0x5564f2c20ac1f1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.816186:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000192d521a/0x5564f2c20ac1f1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.816194:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000192d521a/0x5564f2c20ac1f1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.816222:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786100704.816233:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100704.816238:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000192d521a/0x5564f2c20ac1f1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.816244:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbba200 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100704.816250:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000192d521a/0x5564f2c20ac1f1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.816257:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000192d521a/0x5564f2c20ac1f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.816269:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000192d521a/0x5564f2c20ac1f1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.816276:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000192d521a/0x5564f2c20ac1f1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.816293:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.816295:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.816297:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100704.817008:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100704.817017:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1786100704.819003:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786100704.819017:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0957168/0x5564f2c20ac1f23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.819037:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1786100704.819046:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100704.819054:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0957168/0x5564f2c20ac1f23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.819069:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0957168/0x5564f2c20ac1f23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.819081:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0957168/0x5564f2c20ac1f23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.819089:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0957168/0x5564f2c20ac1f23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.819113:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786100704.819132:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100704.819139:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0957168/0x5564f2c20ac1f23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.819147:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbe00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100704.819151:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0957168/0x5564f2c20ac1f23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.819162:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0957168/0x5564f2c20ac1f23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.819178:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0957168/0x5564f2c20ac1f23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.819196:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0957168/0x5564f2c20ac1f23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.819215:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.819217:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.819219:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100704.820551:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.820564:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e813ed/0x5564f2c20ac1f2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.820581:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.820585:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.820591:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e813ed/0x5564f2c20ac1f2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.820606:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e813ed/0x5564f2c20ac1f2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.820617:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e813ed/0x5564f2c20ac1f2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.820632:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e813ed/0x5564f2c20ac1f2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.820902:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786100704.821405:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100704.821415:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e813ed/0x5564f2c20ac1f2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.821426:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100704.821431:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e813ed/0x5564f2c20ac1f2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.821441:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e813ed/0x5564f2c20ac1f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.821462:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e813ed/0x5564f2c20ac1f2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.821471:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e813ed/0x5564f2c20ac1f2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.821492:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.821495:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.821497:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100704.822532:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.822545:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f86932af/0x5564f2c20ac1f31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.822562:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.822568:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.822574:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f86932af/0x5564f2c20ac1f31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.822588:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f86932af/0x5564f2c20ac1f31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.822597:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f86932af/0x5564f2c20ac1f31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.822605:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f86932af/0x5564f2c20ac1f31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.823250:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786100704.825257:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.825276:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0c00d40/0x5564f2c20ac1f38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.825307:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.825312:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.825332:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c00d40/0x5564f2c20ac1f38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.825351:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0c00d40/0x5564f2c20ac1f38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.825364:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0c00d40/0x5564f2c20ac1f38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.825372:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c00d40/0x5564f2c20ac1f38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.827949:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786100704.827969:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f86932af/0x5564f2c20ac1f31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.827987:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f000 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100704.827993:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f86932af/0x5564f2c20ac1f31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.828005:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f86932af/0x5564f2c20ac1f31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.828032:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f86932af/0x5564f2c20ac1f31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.828040:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f86932af/0x5564f2c20ac1f31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.828072:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100704.828076:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0c00d40/0x5564f2c20ac1f38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.828083:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fc00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100704.828086:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0c00d40/0x5564f2c20ac1f38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.828094:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0c00d40/0x5564f2c20ac1f38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.828141:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0c00d40/0x5564f2c20ac1f38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.828149:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.828151:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.828153:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100704.834685:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786100704.834706:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0c00d40/0x5564f2c20ac1f38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786100704.835567:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.835578:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffef36a1/0x5564f2c20ac1f3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.835596:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.835606:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.835615:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffef36a1/0x5564f2c20ac1f3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.835645:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffef36a1/0x5564f2c20ac1f3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.835683:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffef36a1/0x5564f2c20ac1f3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.835691:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffef36a1/0x5564f2c20ac1f3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.835716:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100704.835731:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100704.835739:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffef36a1/0x5564f2c20ac1f3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.835749:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100704.835755:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffef36a1/0x5564f2c20ac1f3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.835765:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffef36a1/0x5564f2c20ac1f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.835785:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffef36a1/0x5564f2c20ac1f3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.835793:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffef36a1/0x5564f2c20ac1f3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.835823:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100704.835825:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100704.835828:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100704.836398:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.836407:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005beddeb3/0x5564f2c20ac1f46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.836418:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.836422:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.836431:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005beddeb3/0x5564f2c20ac1f46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.836443:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005beddeb3/0x5564f2c20ac1f46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.836453:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005beddeb3/0x5564f2c20ac1f46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.836461:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005beddeb3/0x5564f2c20ac1f46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.836479:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786100704.836485:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100704.836492:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005beddeb3/0x5564f2c20ac1f46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.836502:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165fa00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100704.836506:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005beddeb3/0x5564f2c20ac1f46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.836525:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005beddeb3/0x5564f2c20ac1f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.836544:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005beddeb3/0x5564f2c20ac1f46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.836552:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005beddeb3/0x5564f2c20ac1f46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.836575:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.836578:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.836581:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100704.836996:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.837003:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba1c6c14/0x5564f2c20ac1f4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.837025:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.837029:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.837033:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba1c6c14/0x5564f2c20ac1f4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.837044:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba1c6c14/0x5564f2c20ac1f4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.837052:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba1c6c14/0x5564f2c20ac1f4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.837060:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba1c6c14/0x5564f2c20ac1f4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.837089:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786100704.837908:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100704.837918:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba1c6c14/0x5564f2c20ac1f4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.837929:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386000 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100704.837933:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba1c6c14/0x5564f2c20ac1f4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.837943:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba1c6c14/0x5564f2c20ac1f4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.837963:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba1c6c14/0x5564f2c20ac1f4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.837971:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba1c6c14/0x5564f2c20ac1f4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.837990:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.837992:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.837993:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.839557:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100704.845429:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.845451:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e269c956/0x5564f2c20ac1f54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.845473:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.845479:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.845487:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e269c956/0x5564f2c20ac1f54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.845505:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e269c956/0x5564f2c20ac1f54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.845535:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e269c956/0x5564f2c20ac1f54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.845544:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e269c956/0x5564f2c20ac1f54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.845585:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786100704.846277:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100704.846290:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e269c956/0x5564f2c20ac1f54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.846303:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100704.846308:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e269c956/0x5564f2c20ac1f54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.846329:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e269c956/0x5564f2c20ac1f54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.846357:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e269c956/0x5564f2c20ac1f54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.846377:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e269c956/0x5564f2c20ac1f54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.846406:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100704.846409:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100704.846411:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100704.847988:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.848004:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.848023:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.848028:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.848036:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.848050:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.848061:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.848070:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.848119:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100704.848135:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100704.848141:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.848149:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387200 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100704.848153:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.848162:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.848178:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.848185:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.848205:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100704.848206:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100704.848208:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100704.853567:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.853583:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000891b2c3b/0x5564f2c20ac1f62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.853604:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.853616:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.853623:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000891b2c3b/0x5564f2c20ac1f62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.853639:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000891b2c3b/0x5564f2c20ac1f62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.855085:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000891b2c3b/0x5564f2c20ac1f62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.855173:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000891b2c3b/0x5564f2c20ac1f62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.855203:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786100704.856412:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100704.856427:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000891b2c3b/0x5564f2c20ac1f62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.856440:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387a00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100704.856445:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000891b2c3b/0x5564f2c20ac1f62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.856456:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000891b2c3b/0x5564f2c20ac1f62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.856483:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000891b2c3b/0x5564f2c20ac1f62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.856492:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000891b2c3b/0x5564f2c20ac1f62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.856517:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100704.856519:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100704.856521:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100704.859482:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.859500:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000277b8394/0x5564f2c20ac1f69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.859520:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.859525:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.859533:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000277b8394/0x5564f2c20ac1f69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.860540:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000277b8394/0x5564f2c20ac1f69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.860562:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000277b8394/0x5564f2c20ac1f69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.861848:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000277b8394/0x5564f2c20ac1f69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.862077:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786100704.863133:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.863145:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.863162:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.863168:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.863175:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.863190:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.863200:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.863208:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.863232:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1786100704.866937:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.866955:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000325ce3d3/0x5564f2c20ac1f77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.866985:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.866991:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.866998:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000325ce3d3/0x5564f2c20ac1f77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.867015:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000325ce3d3/0x5564f2c20ac1f77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.867026:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000325ce3d3/0x5564f2c20ac1f77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.867035:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000325ce3d3/0x5564f2c20ac1f77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.867048:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1786100704.869027:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786100704.869043:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000277b8394/0x5564f2c20ac1f69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.869059:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386a00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100704.869064:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000277b8394/0x5564f2c20ac1f69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.869076:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000277b8394/0x5564f2c20ac1f69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.869948:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000277b8394/0x5564f2c20ac1f69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.869965:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000277b8394/0x5564f2c20ac1f69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.869991:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786100704.869995:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.870008:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387200 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100704.870012:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.870021:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.870050:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.870056:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005743134e/0x5564f2c20ac1f70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.870072:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100704.870075:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000325ce3d3/0x5564f2c20ac1f77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.870082:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100704.870085:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000325ce3d3/0x5564f2c20ac1f77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.870092:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000325ce3d3/0x5564f2c20ac1f77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.870100:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000325ce3d3/0x5564f2c20ac1f77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.870119:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000325ce3d3/0x5564f2c20ac1f77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.870132:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100704.870134:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100704.870143:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100704.870289:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.870299:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c860578/0x5564f2c20ac1f7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.870313:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.870317:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.870335:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c860578/0x5564f2c20ac1f7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.870348:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c860578/0x5564f2c20ac1f7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.870370:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c860578/0x5564f2c20ac1f7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.870379:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c860578/0x5564f2c20ac1f7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.870404:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786100704.870818:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100704.870834:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c860578/0x5564f2c20ac1f7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.870849:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386c00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100704.870855:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c860578/0x5564f2c20ac1f7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.870866:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c860578/0x5564f2c20ac1f7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.870890:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c860578/0x5564f2c20ac1f7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100704.870901:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.870919:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c860578/0x5564f2c20ac1f7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.870950:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.870953:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.870956:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100704.871848:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.871860:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a4ce01/0x5564f2c20ac1f85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.871876:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.871880:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.871885:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a4ce01/0x5564f2c20ac1f85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.871896:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4a4ce01/0x5564f2c20ac1f85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.871906:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a4ce01/0x5564f2c20ac1f85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.871914:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a4ce01/0x5564f2c20ac1f85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.871952:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786100704.872635:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.872644:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033e3f7b1/0x5564f2c20ac1f8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.872870:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.872874:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.872880:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033e3f7b1/0x5564f2c20ac1f8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.872894:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033e3f7b1/0x5564f2c20ac1f8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.872904:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033e3f7b1/0x5564f2c20ac1f8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.872912:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033e3f7b1/0x5564f2c20ac1f8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.872937:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1786100704.872983:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786100704.872997:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4a4ce01/0x5564f2c20ac1f85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.873010:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100704.873015:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a4ce01/0x5564f2c20ac1f85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.873027:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a4ce01/0x5564f2c20ac1f85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.873050:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4a4ce01/0x5564f2c20ac1f85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.873057:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4a4ce01/0x5564f2c20ac1f85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.873087:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100704.873091:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033e3f7b1/0x5564f2c20ac1f8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.873120:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386e00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100704.873124:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033e3f7b1/0x5564f2c20ac1f8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.873133:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033e3f7b1/0x5564f2c20ac1f8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.873156:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033e3f7b1/0x5564f2c20ac1f8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.873163:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033e3f7b1/0x5564f2c20ac1f8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.873184:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.873187:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.873193:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100704.873510:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.873519:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000105c671b/0x5564f2c20ac1f93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.873529:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.873539:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.873544:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000105c671b/0x5564f2c20ac1f93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.873554:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000105c671b/0x5564f2c20ac1f93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.873563:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000105c671b/0x5564f2c20ac1f93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.873571:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000105c671b/0x5564f2c20ac1f93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.873679:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786100704.874098:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.874106:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1f9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.874117:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.874121:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.874126:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1f9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.874138:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1f9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874148:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100704.874149:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1f9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874159:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000105c671b/0x5564f2c20ac1f93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.874179:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1f9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874183:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100704.874193:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000105c671b/0x5564f2c20ac1f93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.874198:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786100704.874213:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000105c671b/0x5564f2c20ac1f93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874245:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000105c671b/0x5564f2c20ac1f93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874253:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000105c671b/0x5564f2c20ac1f93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874279:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100704.874283:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1f9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874291:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100704.874297:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1f9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874305:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1f9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874331:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1f9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874339:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011e1592f/0x5564f2c20ac1f9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874357:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.874359:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.874370:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100704.874727:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.874735:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1fa1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.874744:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.874748:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.874751:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1fa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.874760:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1fa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.874768:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1fa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.874774:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1fa1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.874796:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786100704.874931:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100704.874938:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1fa1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874948:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100704.874952:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1fa1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874959:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1fa1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874973:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1fa1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874980:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1fa1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.874997:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.874999:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.875000:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.875508:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786100704.878137:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1786100704.879604:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.879618:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093a74b39/0x5564f2c20ac1fa8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.879803:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.879808:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.879816:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093a74b39/0x5564f2c20ac1fa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.879836:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093a74b39/0x5564f2c20ac1fa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.879849:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093a74b39/0x5564f2c20ac1fa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.879858:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093a74b39/0x5564f2c20ac1fa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.879884:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786100704.880479:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100704.880495:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093a74b39/0x5564f2c20ac1fa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.880511:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387c00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100704.880515:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093a74b39/0x5564f2c20ac1fa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.880551:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093a74b39/0x5564f2c20ac1fa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.880574:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093a74b39/0x5564f2c20ac1fa8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.880581:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093a74b39/0x5564f2c20ac1fa8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100704.880608:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.880610:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100704.880612:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100704.884086:0:15011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100704.884172:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1faf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.884201:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1786100704.884206:0:15011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100704.884216:0:15011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1faf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.884236:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1faf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.884266:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1faf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.884275:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1faf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100704.884414:0:15011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1786100704.885003:0:15011:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1786100704.885413:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14351:x1872861960697600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 123214us (125695us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100704.885431:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1786100704.885778:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100704.885790:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1faf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.885805:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100704.885812:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1faf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.885823:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1faf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.885846:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1faf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.885854:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bd0b6f6/0x5564f2c20ac1faf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100704.885880:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.885883:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100704.885884:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100704.886184:0:14351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42517480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14351:1872861960697600:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1786100704.886212:0:14351:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1786100704.886280:0:14351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42517480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14351:1872861960697728:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1786100704.886423:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100704.886542:0:14351:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583e4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786100704.886587:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960697728 00000100:00100000:1.0:1786100704.886596:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960697728 00000100:00100000:1.0:1786100704.886875:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786100704.886935:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14351:x1872861960697728:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1786100704.886999:0:15010:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1786100704.894629:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14351:x1872861960697728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7735us (8197us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1786100704.894647:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786100704.894904:0:14351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42517480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14351:1872861960697728:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1786100704.894924:0:14351:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1786100705.700924:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1786100706.546052:0:15725:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1786100706.546058:0:15725:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1786100706.546257:0:15725:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a3c60c8f000 00000020:01000004:3.0:1786100706.546277:0:15725:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1786100706.546294:0:15725:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1786100706.546507:0:15725:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a3c7c0199c0) 00000020:00000080:3.0:1786100706.546531:0:15725:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1786100706.579525:0:15725:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1786100706.580158:0:15725:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1786100706.581284:0:15725:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1786100706.583389:0:15725:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1786100706.584010:0:15725:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1786100706.584587:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 531: rc = 0 00100000:10000000:2.0:1786100706.584816:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 531: rc = 0 00100000:10000000:2.0:1786100706.584997:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 531: rc = 0 00100000:10000000:2.0:1786100706.585893:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1786100706.586392:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1786100706.586807:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1786100706.590444:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1786100706.590850:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1786100706.592056:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00000020:00000080:2.0:1786100706.593306:0:15725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1786100706.593391:0:15725:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1786100706.593406:0:15725:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5564f2c20ac1fbd 00000020:01000004:2.0:1786100706.593417:0:15725:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1786100706.593444:0:15725:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.153@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1786100706.593448:0:15725:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1786100706.593456:0:15725:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1786100706.593484:0:15725:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1786100706.593489:0:15725:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1786100706.617621:0:15725:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786100706.618020:0:15725:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.153@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1786100706.618027:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786100706.618029:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786100706.618030:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786100706.618032:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786100706.618033:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786100706.618034:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786100706.618036:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786100706.618038:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786100706.618039:0:15725:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786100706.618044:0:15725:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1786100706.618046:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786100706.618048:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786100706.618049:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786100706.618050:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786100706.618051:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786100706.618052:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786100706.618053:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786100706.618054:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786100706.618055:0:15725:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786100706.618091:0:15725:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1786100706.618639:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960697856:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786100706.619602:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100706.620929:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47257a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786100706.621116:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960697856 00000100:00100000:3.0:1786100706.621129:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960697856 00000100:00100000:3.0:1786100706.621222:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786100706.621234:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+16:15725:x1872861960697856:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1786100706.621279:0:14321:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1786100706.621283:0:14321:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1786100706.621288:0:14321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1786100706.632591:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+16:15725:x1872861960697856:12345-0@lo:253:mount.lustre.0 Request processed in 11345us (12978us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100706.632610:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1786100706.632866:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960697856:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1786100706.632886:0:15725:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1786100706.632890:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786100706.632892:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786100706.632894:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786100706.632895:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786100706.632896:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786100706.632898:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786100706.632899:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786100706.632901:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786100706.632902:0:15725:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1786100706.632926:0:15725:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a3c60c8f000 from lustre-OST0001 10000000:01000000:2.0:1786100706.632957:0:15725:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1786100706.632960:0:15725:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1786100706.632969:0:15725:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a3c7f4f19c0 local copy 00010000:00010000:2.0:1786100706.632982:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98e00/0x5564f2c20ac1d63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d6a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100706.634480:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960697984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786100706.634646:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100706.634848:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47257240 going to sleep for 11 seconds 00000100:00100000:1.0:1786100706.635054:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960697984 00000100:00100000:1.0:1786100706.635065:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960697984 00000100:00100000:3.0:1786100706.635294:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786100706.635413:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+16:15725:x1872861960697984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786100706.635998:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+16:15725:x1872861960697984:12345-0@lo:501:mount.lustre.0 Request processed in 692us (1350us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786100706.636018:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1786100706.636166:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960697984:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1786100706.636190:0:15725:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1786100706.636488:0:15725:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1786100706.636586:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98e00/0x5564f2c20ac1d63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d6a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100706.636598:0:15725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98e00/0x5564f2c20ac1d63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1d6a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786100706.636643:0:15725:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a3c60c8f000 10000000:01000000:2.0:1786100706.636823:0:15725:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1786100706.636831:0:15725:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1786100706.636920:0:15725:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786100706.636927:0:15725:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1786100706.636931:0:15725:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1786100706.636970:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98a00/0x5564f2c20ac1fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.636980:0:15725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98a00/0x5564f2c20ac1fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.636994:0:15725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98a00/0x5564f2c20ac1fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100706.637020:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42514000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786100706.637068:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100706.637286:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c506c3840 going to sleep for 11 seconds 00000100:00100000:1.0:1786100706.637387:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960698112 00000100:00100000:1.0:1786100706.637396:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960698112 00000100:00100000:1.0:1786100706.637485:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786100706.637507:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+16:15725:x1872861960698112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786100706.637521:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100706.637545:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac1fcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1fc4 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100706.637573:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac1fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1fc4 expref: 17 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100706.637586:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c62386e00/0x5564f2c20ac1fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1fc4 expref: 17 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100706.637597:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62386e00, rc 0) 00000100:00100000:1.0:1786100706.637757:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+17:15725:x1872861960698112:12345-0@lo:101:mount.lustre.0 Request processed in 145us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100706.637766:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786100706.637849:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42514000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698112:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786100706.637864:0:15725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98a00/0x5564f2c20ac1fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1fcb expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.637881:0:15725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98a00/0x5564f2c20ac1fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1fcb expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786100706.639081:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1786100706.643054:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786100706.646063:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1786100706.646919:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1786100706.646965:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1786100706.647027:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1786100706.647065:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1786100706.647172:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1786100706.647874:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1786100706.647886:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1786100706.648035:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786100706.648508:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.648567:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736180 going to sleep for 11 seconds 00000100:00100000:3.0:1786100706.649065:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960698240 00000100:00100000:3.0:1786100706.649076:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960698240 00000100:00100000:3.0:1786100706.649276:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786100706.649289:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+17:15725:x1872861960698240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786100706.650300:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786100706.650379:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786100706.650569:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+17:15725:x1872861960698240:12345-0@lo:501:mount.lustre.0 Request processed in 1281us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100706.650580:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786100706.650795:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.650835:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736180 going to sleep for 11 seconds 00000100:00100000:3.0:1786100706.650913:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960698368 00000100:00100000:3.0:1786100706.650927:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960698368 00000100:00100000:3.0:1786100706.650970:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1786100706.650978:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+17:15725:x1872861960698368:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786100706.651565:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+17:15725:x1872861960698368:12345-0@lo:503:mount.lustre.0 Request processed in 585us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100706.651575:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786100706.651799:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698368:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1786100706.655299:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786100706.655564:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786100706.656406:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.656528:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736180 going to sleep for 11 seconds 00000100:00100000:3.0:1786100706.660904:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960698496 00000100:00100000:3.0:1786100706.660927:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960698496 00000100:00100000:3.0:1786100706.661016:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1786100706.661029:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+17:15725:x1872861960698496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786100706.662091:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+17:15725:x1872861960698496:12345-0@lo:502:mount.lustre.0 Request processed in 1058us (5680us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100706.662111:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786100706.662643:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786100706.663289:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1786100706.663371:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1786100706.663407:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1786100706.663458:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1786100706.663500:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1786100706.663534:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1786100706.663586:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1786100706.663620:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1786100706.663839:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1786100706.663891:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786100706.663972:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.664028:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736180 going to sleep for 11 seconds 00000100:00100000:2.0:1786100706.664187:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960698624 00000100:00100000:2.0:1786100706.664262:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960698624 00000100:00100000:2.0:1786100706.664375:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1786100706.664386:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+17:15725:x1872861960698624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786100706.664633:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+17:15725:x1872861960698624:12345-0@lo:502:mount.lustre.0 Request processed in 248us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100706.664642:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786100706.664847:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786100706.664948:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1786100706.664960:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1786100706.667815:0:15726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786100706.667833:0:15726:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1786100706.667842:0:15726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100706.667845:0:15726:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1786100706.667854:0:15726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786100706.667876:0:15726:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a3c44f30000) 00000020:00000080:0.0:1786100706.667909:0:15726:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1786100706.667918:0:15726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1786100706.668253:0:15726:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a3c60c8f000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1786100706.668264:0:15726:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1786100706.668285:0:15726:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5564f2c20ac1fd9 00010000:00010000:0.0:1786100706.675881:0:15726:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1786100706.676427:0:15726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1786100706.682056:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1786100706.683935:0:15726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1786100706.684072:0:15726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100706.684082:0:15726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100706.684085:0:15726:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1786100706.684090:0:15726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786100706.684095:0:15726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100706.684096:0:15726:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786100706.684108:0:15726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786100706.684111:0:15726:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1786100706.684114:0:15726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100706.684116:0:15726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100706.684118:0:15726:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1786100706.684120:0:15726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786100706.684123:0:15726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100706.684124:0:15726:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1786100706.684128:0:15726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1786100706.684199:0:15726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786100706.684203:0:15726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786100706.684204:0:15726:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1786100706.684207:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1786100706.684616:0:15725:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1786100706.684780:0:15725:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1786100706.685043:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98a00/0x5564f2c20ac1fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1fcb expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.685058:0:15725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa98a00/0x5564f2c20ac1fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1fcb expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100706.685068:0:15725:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c60c8f000 from 1 10000000:01000000:3.0:1786100706.685070:0:15725:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786100706.685129:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.685138:0:15725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.685161:0:15725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100706.685207:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786100706.685294:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100706.685363:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c506c3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786100706.685406:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960698752 00000100:00100000:1.0:1786100706.685416:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960698752 00000100:00100000:1.0:1786100706.685482:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1786100706.685492:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+17:15725:x1872861960698752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786100706.685509:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100706.685525:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac1fe7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1fe0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100706.686482:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac1fe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1fe0 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100706.686514:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac1fe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1fe0 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100706.686526:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c62387600, rc 0) 00000100:00100000:2.0:1786100706.687260:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786100706.687285:0:15725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1fe7 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100706.687298:0:15725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1fe7 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100706.687743:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+18:15725:x1872861960698752:12345-0@lo:101:mount.lustre.0 Request processed in 2249us (2446us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100706.687755:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000040:00080000:2.0:1786100706.693360:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1786100706.697554:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786100706.705892:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1786100706.706015:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1786100706.706430:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1786100706.706444:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1786100706.706593:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786100706.706713:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100706.706769:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c506c3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786100706.707683:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960698880 00000100:00100000:1.0:1786100706.707696:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960698880 00000100:00100000:1.0:1786100706.707763:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1786100706.708226:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+18:15725:x1872861960698880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786100706.710830:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+18:15725:x1872861960698880:12345-0@lo:501:mount.lustre.0 Request processed in 3045us (4105us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100706.710848:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786100706.711004:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960698880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786100706.711076:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786100706.711154:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100706.711207:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c506c3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786100706.711234:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960699008 00000100:00100000:3.0:1786100706.711241:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960699008 00000100:00100000:3.0:1786100706.711284:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1786100706.711293:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+18:15725:x1872861960699008:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786100706.711513:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+18:15725:x1872861960699008:12345-0@lo:503:mount.lustre.0 Request processed in 220us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100706.711522:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786100706.711565:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699008:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1786100706.713594:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786100706.714579:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786100706.715371:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.715480:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786100706.715536:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960699136 00000100:00100000:0.0:1786100706.715547:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960699136 00000100:00100000:0.0:1786100706.716295:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1786100706.716319:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+18:15725:x1872861960699136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786100706.716856:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+18:15725:x1872861960699136:12345-0@lo:502:mount.lustre.0 Request processed in 549us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100706.716866:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1786100706.717061:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786100706.717452:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1786100706.717514:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1786100706.717571:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1786100706.717628:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1786100706.717701:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1786100706.717767:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1786100706.717824:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1786100706.717859:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1786100706.717923:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699264:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786100706.717989:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.718040:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786100706.718185:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960699264 00000100:00100000:2.0:1786100706.718264:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960699264 00000100:00100000:2.0:1786100706.718330:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1786100706.718340:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+18:15725:x1872861960699264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786100706.718573:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+18:15725:x1872861960699264:12345-0@lo:502:mount.lustre.0 Request processed in 234us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100706.718581:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1786100706.722233:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699264:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786100706.722518:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1786100706.722538:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00010000:00010000:1.0:1786100706.725360:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1786100706.726218:0:15731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100706.726234:0:15731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100706.726251:0:15731:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1786100706.726259:0:15731:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a3c60c8f000 00000020:00000080:0.0:1786100706.726263:0:15731:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786100706.726273:0:15731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100706.726276:0:15731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100706.726277:0:15731:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1786100706.726280:0:15731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100706.726283:0:15731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100706.726284:0:15731:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1786100706.726288:0:15731:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a3c60c8f000 00000020:00000080:0.0:1786100706.726290:0:15731:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786100706.726370:0:15731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100706.726374:0:15731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100706.726376:0:15731:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1786100706.726378:0:15731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786100706.726381:0:15731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100706.726382:0:15731:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1786100706.726387:0:15731:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a3c60c8f000 00000020:00000080:0.0:1786100706.726390:0:15731:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786100706.726440:0:15731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786100706.726444:0:15731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786100706.726446:0:15731:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1786100706.726449:0:15731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1786100706.727206:0:15725:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1786100706.727256:0:15725:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786100706.727275:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1fe7 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100706.727291:0:15725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1fe7 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100706.727369:0:15725:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1786100706.727373:0:15725:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a3c60c8f000 10000000:01000000:1.0:1786100706.727377:0:15725:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a3c60c8f000 10000000:01000000:1.0:1786100706.727382:0:15725:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786100706.727390:0:15725:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a3c60c8f000 from 1 10000000:01000000:1.0:1786100706.727393:0:15725:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786100706.727450:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386c00/0x5564f2c20ac1fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100706.727460:0:15725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c62386c00/0x5564f2c20ac1fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100706.727496:0:15725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c62386c00/0x5564f2c20ac1fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100706.727528:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786100706.728236:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.728366:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786100706.728891:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960699392 00000100:00100000:2.0:1786100706.728901:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960699392 00000100:00100000:2.0:1786100706.728957:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786100706.728970:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+18:15725:x1872861960699392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786100706.728990:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100706.729010:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7f51f600/0x5564f2c20ac1ff5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac1fee expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100706.729045:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7f51f600/0x5564f2c20ac1ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac1fee expref: 19 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100706.729059:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7f51f600/0x5564f2c20ac1ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1fee expref: 19 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100706.729088:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f600, rc 0) 00000100:00100000:2.0:1786100706.729226:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+19:15725:x1872861960699392:12345-0@lo:101:mount.lustre.0 Request processed in 257us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100706.729234:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786100706.729364:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786100706.729385:0:15725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c62386c00/0x5564f2c20ac1fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1ff5 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.729396:0:15725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c62386c00/0x5564f2c20ac1fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac1ff5 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786100706.732345:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1786100706.733225:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786100706.735975:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1786100706.736172:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1786100706.736241:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1786100706.736358:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1786100706.736413:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1786100706.736477:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1786100706.736520:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1786100706.736557:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1786100706.736614:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1786100706.736695:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1786100706.736741:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1786100706.737505:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1786100706.737579:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1786100706.737618:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1786100706.737892:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1786100706.737942:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1786100706.737993:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1786100706.738319:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1786100706.738391:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1786100706.738437:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1786100706.738499:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1786100706.738538:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1786100706.738598:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1786100706.738688:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1786100706.738732:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1786100706.738882:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1786100706.738947:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1786100706.738994:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1786100706.739043:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1786100706.739250:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1786100706.739291:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1786100706.739342:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1786100706.739390:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1786100706.739474:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1786100706.739532:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1786100706.739602:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1786100706.739887:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1786100706.740043:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1786100706.740170:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1786100706.740307:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786100706.742852:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.742932:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100706.743359:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960699520 00000100:00100000:0.0:1786100706.743372:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960699520 00000100:00100000:0.0:1786100706.743457:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786100706.743470:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:15725:x1872861960699520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786100706.744236:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:15725:x1872861960699520:12345-0@lo:501:mount.lustre.0 Request processed in 766us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100706.744248:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1786100706.744508:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786100706.744641:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786100706.744937:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.745014:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100706.745606:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960699648 00000100:00100000:0.0:1786100706.745615:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960699648 00000100:00100000:0.0:1786100706.745803:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786100706.745815:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+19:15725:x1872861960699648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786100706.748041:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+19:15725:x1872861960699648:12345-0@lo:503:mount.lustre.0 Request processed in 2216us (3091us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100706.748046:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699648:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786100706.748056:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000040:00080000:1.0:1786100706.753624:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786100706.753898:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786100706.762516:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.762602:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100706.763727:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960699776 00000100:00100000:0.0:1786100706.763740:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960699776 00000100:00100000:0.0:1786100706.763865:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1786100706.763877:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:15725:x1872861960699776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786100706.764306:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:15725:x1872861960699776:12345-0@lo:502:mount.lustre.0 Request processed in 430us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100706.764326:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786100706.764395:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786100706.764858:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1786100706.764925:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1786100706.764959:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1786100706.765021:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1786100706.765063:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1786100706.765119:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1786100706.765157:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1786100706.765194:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1786100706.765259:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1786100706.765348:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1786100706.765394:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1786100706.765452:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1786100706.765505:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1786100706.765545:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1786100706.765598:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1786100706.765637:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1786100706.765748:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1786100706.765816:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1786100706.765863:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1786100706.765906:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1786100706.765971:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1786100706.766018:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1786100706.766062:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1786100706.766120:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1786100706.766159:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1786100706.766224:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1786100706.766301:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1786100706.766365:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1786100706.766414:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1786100706.766474:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1786100706.766541:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1786100706.766578:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1786100706.766616:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1786100706.766699:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1786100706.766746:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1786100706.766830:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1786100706.766872:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1786100706.766905:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1786100706.766950:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1786100706.766990:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1786100706.767065:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786100706.767167:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100706.767274:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960699904 00000100:00100000:0.0:1786100706.767284:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960699904 00000100:00100000:0.0:1786100706.767369:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786100706.767380:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+19:15725:x1872861960699904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786100706.767700:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+19:15725:x1872861960699904:12345-0@lo:502:mount.lustre.0 Request processed in 321us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100706.767708:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786100706.773916:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d736cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100706.776902:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960699904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786100706.778269:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1786100706.778294:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1786100706.787263:0:15736:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1786100706.787287:0:15736:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a3c4516b380) 00000020:00000080:2.0:1786100706.787328:0:15736:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1786100706.788374:0:15736:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a3c60c8f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1786100706.788384:0:15736:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a3c60c8f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1786100706.788388:0:15736:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a3c60c8f000 3 00010000:00080000:2.0:1786100706.788427:0:15736:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a3b42765000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.153@tcp at head 00010000:00010000:2.0:1786100706.794341:0:15736:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1786100706.794762:0:15736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1786100706.794816:0:15736:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1786100706.794834:0:15736:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5564f2c20ac2003 00000100:00080000:2.0:1786100706.794848:0:15736:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786100706.794855:0:15736:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a3b42765000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:2.0:1786100706.794903:0:15736:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3c473d3800 x1872861960700032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786100706.794931:0:15736:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1786100706.795014:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786100706.795019:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1786100706.795023:0:467:0:(import.c:65:import_set_state_nolock()) ffff9a3c60f67000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786100706.795028:0:467:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 445 00000100:00080000:2.0:1786100706.795034:0:467:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1786100706.795039:0:467:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a3c60f67000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:2.0:1786100706.795068:0:467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3c473d0e00 x1872861960700288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786100706.795872:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1872861960700032:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1786100706.796495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.796563:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960700288:0@lo:8:kworker.0 00000100:00100000:1.0:1786100706.796600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.796688:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960700032 00000100:00100000:1.0:1786100706.796698:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960700032 00000100:00100000:1.0:1786100706.796856:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786100706.796868:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1872861960700032:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1786100706.796905:0:14328:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1786100706.796974:0:14328:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5564f2c20ac200a 00000004:00100000:1.0:1786100706.797122:0:14328:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786100706.797167:0:14328:0:(import.c:65:import_set_state_nolock()) ffff9a3b422f7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786100706.797255:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960700160:0@lo:400:kworker.0 00000100:00100000:1.0:1786100706.797257:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1872861960700032:12345-0@lo:38:llog_process_th.0 Request processed in 386us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100706.797270:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786100706.797300:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.797321:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960700288 00000100:00100000:1.0:1786100706.797327:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960700288 00000100:00100000:1.0:1786100706.797354:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960700160 00000100:00100000:1.0:1786100706.797358:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960700160 00000100:00100000:2.0:1786100706.797369:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960700416:0@lo:400:kworker.0 00000100:00100000:2.0:1786100706.797403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100706.797410:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786100706.797428:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786100706.797434:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960700544:0@lo:400:kworker.0 00000100:00100000:2.0:1786100706.797464:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100706.797494:0:15012:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1786100706.797503:0:15012:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1786100706.797519:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960700416 00000100:00100000:2.0:1786100706.797523:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960700416 00000100:00100000:2.0:1786100706.797544:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960700544 00000100:00100000:2.0:1786100706.797558:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960700544 00000100:00100000:2.0:1786100706.797576:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786100706.797583:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960700416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100706.797621:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1872861960700416:12345-0@lo:400:kworker.0 Request processed in 39us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100706.797629:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786100706.797642:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786100706.797665:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960700544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100706.797693:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1872861960700544:12345-0@lo:400:kworker.0 Request processed in 46us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100706.797699:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1786100706.797735:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d1c00 x1872861960700544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100706.797764:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1872861960700544:0@lo:400:kworker.0 00010000:00080000:2.0:1786100706.797778:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d2a00 x1872861960700416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786100706.797787:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1872861960700416:0@lo:400:kworker.0 00000100:00100000:1.0:1786100706.798524:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1872861960700160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100706.798603:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1872861960700160:12345-0@lo:400:kworker.0 Request processed in 1185us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100706.798612:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786100706.798736:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786100706.798801:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1872861960700288:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1786100706.798858:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1872861960700288:12345-0@lo:8:kworker.0 Request processed in 57us (2256us total) trans 0 rc -11/-11 00000100:00100000:1.0:1786100706.798864:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1786100706.798905:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786100706.798913:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1786100706.799241:0:15736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1786100706.800742:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960700160:0@lo:400:kworker.0 00010000:00080000:1.0:1786100706.800859:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c473d3800 x1872861960700032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786100716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100706.800874:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786100706.800886:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1786100706.800898:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1786100706.800904:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1786100706.800909:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3b42765000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1786100706.800927:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1872861960700032:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1786100706.800949:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786100706.800954:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c60f67000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786100706.800958:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1786100706.800961:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960700288:0@lo:8:kworker.0 00000020:01000000:0.0:1786100706.801018:0:15725:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1786100706.801060:0:15725:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786100706.801178:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386c00/0x5564f2c20ac1fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1ff5 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.801192:0:15725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c62386c00/0x5564f2c20ac1fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac1ff5 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1786100706.801259:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1786100706.801261:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786100706.801263:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786100706.801264:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786100706.801266:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786100706.801267:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786100706.801269:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786100706.801271:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786100706.801273:0:15725:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786100706.801278:0:15725:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1786100706.801281:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786100706.801283:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786100706.801284:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786100706.801285:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786100706.801286:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786100706.801288:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786100706.801289:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786100706.801290:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786100706.801291:0:15725:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786100706.801330:0:15725:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1786100706.801364:0:15725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960700672:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1786100706.801449:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100706.801502:0:15725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c50c5af00 going to sleep for 11 seconds 00000100:00100000:3.0:1786100706.801806:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960700672 00000100:00100000:3.0:1786100706.801820:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960700672 00000100:00100000:3.0:1786100706.801869:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1786100706.801881:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:15725:x1872861960700672:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1786100706.801915:0:14323:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1786100706.801933:0:14323:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1786100706.884823:0:14323:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786100706.884912:0:14344:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1786100706.884920:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1786100706.884948:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.884972:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa98200/0x5564f2c20ac1ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1edd expref: 19 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.884981:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.885036:0:14344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa98200/0x5564f2c20ac1ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac1edd expref: 19 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.885053:0:14344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c7fa98200/0x5564f2c20ac1ee4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac1edd expref: 19 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100706.885072:0:14344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42514000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14344:1872861960700800:0@lo:104: 00000100:00100000:3.0:1786100706.885165:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100706.885230:0:14344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c71bc7480 going to sleep for 11 seconds 00000100:00100000:3.0:1786100706.885262:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960700800 00000100:00100000:3.0:1786100706.885271:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960700800 00000100:00100000:3.0:1786100706.885634:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786100706.885687:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42516680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0af484e0-17d7-4fef-8244-23d93563e204+3:14344:x1872861960700800:12345-0@lo:104: 00010000:00010000:3.0:1786100706.885705:0:14313:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1ee4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.885797:0:14313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786100706.885807:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42516680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0af484e0-17d7-4fef-8244-23d93563e204+3:14344:x1872861960700800:12345-0@lo:104: Request processed in 160us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100706.885818:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1786100706.885850:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100706.885858:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1ee4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100706.885865:0:14344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42514000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14344:1872861960700800:0@lo:104: 00010000:00010000:3.0:1786100706.885870:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165f200 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:3.0:1786100706.885881:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac1ee4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.885895:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac1ee4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.885903:0:14344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786100706.885905:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac1ee4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786100706.885940:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1786100706.885980:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1ee4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.885989:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786100706.886022:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1ee4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.886029:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4165f200/0x5564f2c20ac1edd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1ee4 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.886060:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100706.886062:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100706.886064:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100706.886074:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 20000000:01000000:2.0:1786100706.886091:0:14323:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1786100706.889165:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960700928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786100706.889472:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100706.889971:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960700928 00000100:00100000:0.0:1786100706.889989:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960700928 00010000:00010000:0.0:1786100706.890051:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa98200/0x5564f2c20ac1ee4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1edd expref: 20 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100706.890096:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786100706.890108:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0af484e0-17d7-4fef-8244-23d93563e204+20:3308:x1872861960700928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786100706.890124:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100706.890130:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa98200/0x5564f2c20ac1ee4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1edd expref: 20 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.890143:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa98200/0x5564f2c20ac1ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac1edd expref: 20 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.890162:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa98200/0x5564f2c20ac1ee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac1edd expref: 20 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.890179:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.890186:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786100706.890202:0:14316:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005642271s 00010000:00010000:0.0:1786100706.890206:0:14316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.890213:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.890239:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.890246:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.890252:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa98600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100706.890256:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.890265:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.890322:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100706.890334:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100706.890417:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0af484e0-17d7-4fef-8244-23d93563e204+19:3308:x1872861960700928:12345-0@lo:103:ldlm_bl.0 Request processed in 312us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100706.890424:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786100706.890543:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960700928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786100706.890898:0:14344:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.890909:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100706.890915:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac2011 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100706.907948:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+18:15725:x1872861960700672:12345-0@lo:253:mount.lustre.0 Request processed in 106058us (106488us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100706.907964:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1786100706.908588:0:15725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0af484e0-17d7-4fef-8244-23d93563e204:15725:1872861960700672:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1786100706.908603:0:15725:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1786100706.908607:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786100706.908608:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786100706.908610:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786100706.908611:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786100706.908612:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786100706.908613:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786100706.908614:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786100706.908616:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786100706.908618:0:15725:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1786100706.908636:0:15725:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1786100706.913483:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100706.913991:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1786100706.914157:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100706.914299:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1786100706.914516:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1786100706.914862:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1786100706.915507:0:15725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1786100706.962346:0:15725:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1786100706.962357:0:15725:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1786100706.962400:0:15725:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1786100706.962457:0:15725:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1786100706.962470:0:15725:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1786100706.962499:0:15725:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1786100707.757539:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786100707.889719:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1786100707.889780:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:1.0:1786100708.453699:0:14326:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1786100708.453706:0:14326:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a3b42967000 from 8 10000000:01000000:1.0:1786100708.453712:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786100708.453758:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386000/0x5564f2c20ac2018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100708.453770:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c62386000/0x5564f2c20ac2018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100708.453781:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c62386000/0x5564f2c20ac2018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100708.453818:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960701056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786100708.453888:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100708.453938:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4473fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1786100708.455733:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960701056 00000100:00100000:2.0:1786100708.455746:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960701056 00000100:00100000:2.0:1786100708.455921:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786100708.458937:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+18:14326:x1872861960701056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786100708.458956:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100708.458973:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7f51fe00/0x5564f2c20ac201f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac2018 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100708.459015:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7f51fe00/0x5564f2c20ac201f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac2018 expref: 19 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100708.459025:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7f51fe00/0x5564f2c20ac201f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac2018 expref: 19 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100708.459034:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51fe00, rc 0) 00000100:00100000:2.0:1786100708.459106:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+19:14326:x1872861960701056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (5219us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100708.459214:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960701056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786100708.459231:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c62386000/0x5564f2c20ac2018 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac201f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100708.459240:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c62386000/0x5564f2c20ac2018 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac201f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100708.459317:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960701184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1786100708.459352:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100708.459386:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c4473fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786100708.459736:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960701184 00000100:00100000:1.0:1786100708.459743:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960701184 00000100:00100000:2.0:1786100708.465928:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786100708.468978:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786100708.468998:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:14326:x1872861960701184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786100708.469026:0:14323:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786100708.469050:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786100708.469053:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1786100708.473251:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:14326:x1872861960701184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 4253us (13890us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100708.473265:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1786100708.473359:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960701184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1786100708.473439:0:14326:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786100708.473448:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c62386000/0x5564f2c20ac2018 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac201f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100708.473459:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c62386000/0x5564f2c20ac2018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac201f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100708.772932:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100709.798805:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100709.805013:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960701312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786100709.805077:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100709.805163:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960701312 00000100:00100000:2.0:1786100709.805170:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960701312 00000100:00100000:2.0:1786100709.805217:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786100709.805225:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960701312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786100709.805254:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100709.805316:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960701312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100709.805323:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1786100709.805342:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786100709.805367:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1786100709.805411:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960701312:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786100710.820993:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786100711.270613:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786100711.844740:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786100711.844772:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786100711.844777:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1786100711.844780:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a3c60f67000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786100711.844792:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a3c60f67000 using connection 192.168.206.153@tcp/0@lo 00000100:00100000:3.0:1786100711.844815:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a3b42514700 x1872861960701696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786100711.844994:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0af484e0-17d7-4fef-8244-23d93563e204:3305:1872861960701440:0@lo:400:kworker.0 00000100:00100000:3.0:1786100711.845060:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100711.845743:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960701696:0@lo:8:kworker.0 00000100:00100000:1.0:1786100711.846442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100711.846509:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960701696 00000100:00100000:1.0:1786100711.846517:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960701696 00000100:00100000:1.0:1786100711.846550:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786100711.846557:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1872861960701696:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1786100711.846585:0:15011:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:1.0:1786100711.846618:0:15011:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5564f2c20ac2026 00002000:00100000:1.0:1786100711.846631:0:15011:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a3b422f1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1786100711.846635:0:15011:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1786100711.846638:0:15011:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1786100711.847220:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960702080:0@lo:400:kworker.0 00000100:00100000:3.0:1786100711.847314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100711.847340:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786100711.847348:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960701568:0@lo:400:kworker.0 00000100:00100000:3.0:1786100711.847374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100711.847406:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960701824:0@lo:400:kworker.0 00000100:00100000:3.0:1786100711.847432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100711.847453:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786100711.847523:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3b42517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960701952:0@lo:400:kworker.0 00000100:00100000:3.0:1786100711.847549:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100711.847583:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960701440 00000100:00100000:3.0:1786100711.847588:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960701440 00000100:00100000:3.0:1786100711.847623:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786100711.847631:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+19:3305:x1872861960701440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100711.847696:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+19:3305:x1872861960701440:12345-0@lo:400:kworker.0 Request processed in 66us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100711.847715:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786100711.847745:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960702080 00000100:00100000:3.0:1786100711.847749:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960702080 00000100:00100000:3.0:1786100711.847777:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960701824 00000100:00100000:3.0:1786100711.847780:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960701824 00000100:00100000:3.0:1786100711.847791:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960701952 00000100:00100000:3.0:1786100711.847793:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960701952 00000100:00100000:3.0:1786100711.847808:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786100711.847814:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1872861960702080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100711.847847:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1872861960702080:12345-0@lo:400:kworker.0 Request processed in 33us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100711.847853:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786100711.847866:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786100711.847872:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960701824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100711.847904:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960701824:12345-0@lo:400:kworker.0 Request processed in 32us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100711.847910:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786100711.847921:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786100711.847927:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960701952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100711.847955:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960701952:12345-0@lo:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100711.847962:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786100711.847982:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960701568 00000100:00100000:3.0:1786100711.847986:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960701568 00000100:00100000:3.0:1786100711.848012:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786100711.848019:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960701568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100711.848059:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960701568:12345-0@lo:400:kworker.0 Request processed in 41us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100711.848066:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1786100711.848084:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786100711.848089:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786100711.848125:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b42517480 x1872861960701952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100711.848138:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960701952:0@lo:400:kworker.0 00010000:00080000:3.0:1786100711.848149:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b42515c00 x1872861960701824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100711.848157:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960701824:0@lo:400:kworker.0 00000100:00100000:3.0:1786100711.848186:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960701568:0@lo:400:kworker.0 00000100:00100000:3.0:1786100711.848194:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0af484e0-17d7-4fef-8244-23d93563e204:3305:1872861960701440:0@lo:400:kworker.0 00010000:00080000:3.0:1786100711.848202:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b42515f80 x1872861960702080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786100727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786100711.848209:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960702080:0@lo:400:kworker.0 00002000:00080000:1.0:1786100711.848439:0:15011:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1786100711.848464:0:15011:0:(import.c:65:import_set_state_nolock()) ffff9a3b422f5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786100711.848519:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1872861960701696:12345-0@lo:8:kworker.0 Request processed in 1960us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100711.848527:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1786100711.848564:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3b42514700 x1872861960701696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786100736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786100711.848577:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1786100711.848585:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1786100711.848591:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1786100711.848594:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9a3c60f67000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1786100711.848613:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1786100711.848625:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3b42514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1872861960701696:0@lo:8:kworker.0 00000004:00080000:3.0:1786100711.848648:0:14352:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1786100711.848713:0:14353:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1786100711.848735:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14353:1872861960702336:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1786100711.848772:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100711.848798:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47289a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786100711.848816:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960702208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100711.848848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100711.848888:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960702208 00000100:00100000:1.0:1786100711.848892:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960702208 00000100:00100000:1.0:1786100711.848929:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786100711.848938:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1872861960702208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100711.848963:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100711.849002:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1872861960702208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100711.849009:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1786100711.849028:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1786100711.849049:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a3c7c10c000 x1872861960702208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786100727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786100711.849067:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960702208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100711.849091:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960702336 00000100:00100000:1.0:1786100711.849095:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960702336 00000004:00080000:3.0:1786100711.849119:0:14352:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 453091466170ns, next at 0ns, rc = 0 00000100:00100000:1.0:1786100711.849124:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786100711.849133:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14353:x1872861960702336:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1786100711.858172:0:15012:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1786100711.858540:0:15012:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1786100711.858546:0:15012:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1786100711.873382:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.873397:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a74b39/0x5564f2c20ac202d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.873414:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.873425:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.873431:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093a74b39/0x5564f2c20ac202d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.873448:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093a74b39/0x5564f2c20ac202d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.873459:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a74b39/0x5564f2c20ac202d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.873536:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093a74b39/0x5564f2c20ac202d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.873561:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.873575:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.873581:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093a74b39/0x5564f2c20ac202d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.873589:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387c00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.873593:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a74b39/0x5564f2c20ac202d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.873602:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a74b39/0x5564f2c20ac202d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.873617:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093a74b39/0x5564f2c20ac202d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.873636:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093a74b39/0x5564f2c20ac202d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.873670:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.873672:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.873674:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.874514:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.874523:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bd0b6f6/0x5564f2c20ac2034 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.874533:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.874537:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.874542:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd0b6f6/0x5564f2c20ac2034 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.874553:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd0b6f6/0x5564f2c20ac2034 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.874561:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bd0b6f6/0x5564f2c20ac2034 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.874568:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bd0b6f6/0x5564f2c20ac2034 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.874588:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.874599:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.874611:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bd0b6f6/0x5564f2c20ac2034 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.874618:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.874622:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bd0b6f6/0x5564f2c20ac2034 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.874630:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bd0b6f6/0x5564f2c20ac2034 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.874643:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bd0b6f6/0x5564f2c20ac2034 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.874682:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd0b6f6/0x5564f2c20ac2034 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.874701:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.874703:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.874704:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.875137:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.875142:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011e1592f/0x5564f2c20ac203b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875151:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.875153:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.875157:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011e1592f/0x5564f2c20ac203b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875176:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011e1592f/0x5564f2c20ac203b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875183:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011e1592f/0x5564f2c20ac203b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875191:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011e1592f/0x5564f2c20ac203b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875204:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.875213:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.875217:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011e1592f/0x5564f2c20ac203b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875224:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.875227:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011e1592f/0x5564f2c20ac203b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875235:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011e1592f/0x5564f2c20ac203b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875246:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011e1592f/0x5564f2c20ac203b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875253:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011e1592f/0x5564f2c20ac203b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875272:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.875273:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.875275:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.875891:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.875898:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000105c671b/0x5564f2c20ac2042 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875907:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.875911:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.875915:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000105c671b/0x5564f2c20ac2042 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875923:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000105c671b/0x5564f2c20ac2042 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875931:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000105c671b/0x5564f2c20ac2042 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875939:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000105c671b/0x5564f2c20ac2042 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875953:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.875961:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.875965:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000105c671b/0x5564f2c20ac2042 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875983:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.875986:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000105c671b/0x5564f2c20ac2042 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.875994:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000105c671b/0x5564f2c20ac2042 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.876006:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000105c671b/0x5564f2c20ac2042 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.876013:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000105c671b/0x5564f2c20ac2042 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.876027:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.876029:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.876031:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.876595:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.876602:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000325ce3d3/0x5564f2c20ac2049 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.876611:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.876615:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.876619:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000325ce3d3/0x5564f2c20ac2049 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.876629:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000325ce3d3/0x5564f2c20ac2049 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.876643:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000325ce3d3/0x5564f2c20ac2049 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.876674:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000325ce3d3/0x5564f2c20ac2049 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.876689:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.876698:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.876702:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000325ce3d3/0x5564f2c20ac2049 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.876709:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.876712:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000325ce3d3/0x5564f2c20ac2049 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.876720:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000325ce3d3/0x5564f2c20ac2049 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.876732:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000325ce3d3/0x5564f2c20ac2049 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.876739:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000325ce3d3/0x5564f2c20ac2049 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.876754:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.876761:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.876763:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.877108:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.877114:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005743134e/0x5564f2c20ac2050 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877122:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.877125:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.877130:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005743134e/0x5564f2c20ac2050 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877138:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005743134e/0x5564f2c20ac2050 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877146:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005743134e/0x5564f2c20ac2050 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877154:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005743134e/0x5564f2c20ac2050 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877165:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.877172:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.877175:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005743134e/0x5564f2c20ac2050 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877181:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387200 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.877185:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005743134e/0x5564f2c20ac2050 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877202:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005743134e/0x5564f2c20ac2050 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877213:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005743134e/0x5564f2c20ac2050 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877219:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005743134e/0x5564f2c20ac2050 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877232:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.877233:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.877235:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.877786:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.877794:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000277b8394/0x5564f2c20ac2057 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877803:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.877806:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.877810:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000277b8394/0x5564f2c20ac2057 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877819:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000277b8394/0x5564f2c20ac2057 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877827:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000277b8394/0x5564f2c20ac2057 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877839:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000277b8394/0x5564f2c20ac2057 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877853:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.877860:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.877864:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000277b8394/0x5564f2c20ac2057 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877871:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62386a00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.877874:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000277b8394/0x5564f2c20ac2057 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877882:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000277b8394/0x5564f2c20ac2057 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877892:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000277b8394/0x5564f2c20ac2057 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877899:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000277b8394/0x5564f2c20ac2057 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.877912:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.877914:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.877915:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.878248:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.878259:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000891b2c3b/0x5564f2c20ac205e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878268:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.878271:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.878275:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000891b2c3b/0x5564f2c20ac205e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878354:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000891b2c3b/0x5564f2c20ac205e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878362:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000891b2c3b/0x5564f2c20ac205e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878369:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000891b2c3b/0x5564f2c20ac205e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878383:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.878392:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.878395:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000891b2c3b/0x5564f2c20ac205e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878402:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387a00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.878405:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000891b2c3b/0x5564f2c20ac205e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878411:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000891b2c3b/0x5564f2c20ac205e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878427:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000891b2c3b/0x5564f2c20ac205e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878434:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000891b2c3b/0x5564f2c20ac205e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878447:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.878449:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.878451:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.878913:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.878919:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e269c956/0x5564f2c20ac2065 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878928:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.878931:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.878935:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e269c956/0x5564f2c20ac2065 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878944:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e269c956/0x5564f2c20ac2065 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878951:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e269c956/0x5564f2c20ac2065 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878957:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e269c956/0x5564f2c20ac2065 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.878980:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.878989:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.878993:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e269c956/0x5564f2c20ac2065 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.879000:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c62387400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.879003:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e269c956/0x5564f2c20ac2065 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.879011:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e269c956/0x5564f2c20ac2065 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.879022:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e269c956/0x5564f2c20ac2065 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.879030:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e269c956/0x5564f2c20ac2065 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.879043:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.879045:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.879046:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.880217:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.880227:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac206c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.880238:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.880247:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.880253:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac206c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.880265:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac206c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.880292:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac206c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.880300:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac206c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.880318:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.880330:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.880334:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac206c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.880341:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897200 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.880345:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac206c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.880351:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac206c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.880364:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac206c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.880381:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac206c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.880398:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.880400:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.880403:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.881020:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.881027:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac2073 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.881035:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.881039:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.881043:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac2073 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.881053:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac2073 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.881062:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac2073 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.881069:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac2073 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.881084:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.881093:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.881103:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac2073 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.881111:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896000 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.881115:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac2073 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.881123:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac2073 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.881135:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac2073 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.881142:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac2073 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.881155:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.881157:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.881158:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.881941:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.881949:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a6543b/0x5564f2c20ac207a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.881958:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.881961:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.881965:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a6543b/0x5564f2c20ac207a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.881984:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a6543b/0x5564f2c20ac207a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.881993:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a6543b/0x5564f2c20ac207a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.882001:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a6543b/0x5564f2c20ac207a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.882015:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786100711.882579:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.882585:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca5bf1a6/0x5564f2c20ac2081 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.882595:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.882598:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.882602:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca5bf1a6/0x5564f2c20ac2081 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.882612:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca5bf1a6/0x5564f2c20ac2081 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.882620:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca5bf1a6/0x5564f2c20ac2081 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.882639:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca5bf1a6/0x5564f2c20ac2081 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.882678:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1786100711.882681:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786100711.882690:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a6543b/0x5564f2c20ac207a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.882690:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100711.882702:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100711.882707:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a6543b/0x5564f2c20ac207a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.882716:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a6543b/0x5564f2c20ac207a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.882736:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a6543b/0x5564f2c20ac207a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.882744:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a6543b/0x5564f2c20ac207a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.882764:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100711.882766:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100711.882774:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.883175:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.883182:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008040c862/0x5564f2c20ac2088 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.883189:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.883192:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.883195:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008040c862/0x5564f2c20ac2088 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.883203:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008040c862/0x5564f2c20ac2088 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.883210:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008040c862/0x5564f2c20ac2088 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.883217:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008040c862/0x5564f2c20ac2088 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.883239:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786100711.884881:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100711.884892:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008040c862/0x5564f2c20ac2088 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.884905:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897e00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100711.884909:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008040c862/0x5564f2c20ac2088 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.884919:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008040c862/0x5564f2c20ac2088 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.884937:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008040c862/0x5564f2c20ac2088 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.884945:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008040c862/0x5564f2c20ac2088 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.884963:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100711.884965:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100711.884967:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.885696:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.885712:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac208f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.885725:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.885731:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.885737:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac208f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.885750:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac208f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.885759:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac208f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.885767:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac208f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.885786:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.885796:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.885801:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac208f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.885808:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896200 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.885812:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac208f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.885820:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac208f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.885841:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac208f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.885848:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac208f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.885866:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.885869:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.885871:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.886337:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.886343:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac2096 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.886353:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.886356:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.886360:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac2096 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.886370:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac2096 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.886379:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac2096 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.886387:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac2096 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.886413:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.886422:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.886427:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac2096 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.886434:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.886438:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac2096 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.886447:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac2096 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.887580:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac2096 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.887592:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac2096 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.887610:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.887612:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.887614:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.888310:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.888319:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac209d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.888331:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.888341:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.888346:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac209d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.888358:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac209d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.888367:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac209d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.888375:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac209d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.888391:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.888402:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.888407:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac209d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.888415:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896a00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.888419:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac209d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.888428:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac209d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.888442:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac209d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.890721:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac209d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.890753:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.890755:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.890757:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.894273:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.896096:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc618e68/0x5564f2c20ac20a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.896117:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.896123:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.896130:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc618e68/0x5564f2c20ac20a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.896144:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc618e68/0x5564f2c20ac20a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.896155:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc618e68/0x5564f2c20ac20a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.896163:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc618e68/0x5564f2c20ac20a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.896194:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.896215:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.896229:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc618e68/0x5564f2c20ac20a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.896237:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.896246:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc618e68/0x5564f2c20ac20a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.896255:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc618e68/0x5564f2c20ac20a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.896272:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc618e68/0x5564f2c20ac20a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.896288:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc618e68/0x5564f2c20ac20a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.896309:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.896312:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.896314:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.897074:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.897082:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ac84481/0x5564f2c20ac20ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.897092:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.897096:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.897101:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac84481/0x5564f2c20ac20ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.897122:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac84481/0x5564f2c20ac20ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.897135:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ac84481/0x5564f2c20ac20ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.897142:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ac84481/0x5564f2c20ac20ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.898562:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.898581:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.898587:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ac84481/0x5564f2c20ac20ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.898598:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897a00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.898602:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ac84481/0x5564f2c20ac20ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.898612:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ac84481/0x5564f2c20ac20ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.898627:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ac84481/0x5564f2c20ac20ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.898634:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac84481/0x5564f2c20ac20ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.898679:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.898681:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.898683:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.899195:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.899203:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a38c1c8/0x5564f2c20ac20b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.899213:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.899216:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.899221:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a38c1c8/0x5564f2c20ac20b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.899230:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a38c1c8/0x5564f2c20ac20b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.899237:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a38c1c8/0x5564f2c20ac20b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.899243:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a38c1c8/0x5564f2c20ac20b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.899257:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.899265:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.899268:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a38c1c8/0x5564f2c20ac20b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.899296:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.899300:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a38c1c8/0x5564f2c20ac20b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.899307:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a38c1c8/0x5564f2c20ac20b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.899318:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a38c1c8/0x5564f2c20ac20b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.899325:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a38c1c8/0x5564f2c20ac20b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.899339:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.899341:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.899342:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100711.900733:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100711.900738:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100711.900740:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.900930:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca5bf1a6/0x5564f2c20ac2081 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.900943:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.900947:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca5bf1a6/0x5564f2c20ac2081 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.900957:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca5bf1a6/0x5564f2c20ac2081 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.900985:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca5bf1a6/0x5564f2c20ac2081 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.900993:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca5bf1a6/0x5564f2c20ac2081 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.901012:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.901015:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.901018:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1786100711.905580:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1786100711.910722:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.910737:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac20b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.910753:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.910757:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.910763:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac20b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.910778:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac20b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.910788:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac20b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.910795:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac20b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.910824:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.910837:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.910842:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac20b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.910849:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.910854:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac20b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.910862:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac20b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.910878:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac20b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.910884:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d8fd294/0x5564f2c20ac20b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.910902:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.910904:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.910905:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.911865:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.911876:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac20c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.911887:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.911896:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.911901:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac20c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.911912:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac20c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.911920:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac20c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.911927:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac20c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.911946:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786100711.912389:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.912395:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac20c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912404:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.912407:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.912411:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac20c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912421:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac20c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912430:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac20c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912443:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac20c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912471:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786100711.912487:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786100711.912492:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac20c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912500:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896200 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.912504:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac20c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912512:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac20c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912527:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac20c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912534:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017b24ccb/0x5564f2c20ac20c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912550:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.912553:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac20c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912571:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896000 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.912574:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac20c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912581:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac20c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912591:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac20c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912598:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007102982d/0x5564f2c20ac20c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.912610:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.912611:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.912613:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.912619:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.913045:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.913051:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac20ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913061:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.913064:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.913069:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac20ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913091:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac20ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913100:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac20ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913107:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac20ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913123:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786100711.913133:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786100711.913138:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac20ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913145:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897200 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100711.913148:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac20ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913157:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac20ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913169:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac20ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913177:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060b06d10/0x5564f2c20ac20ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913199:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.913201:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.913203:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.913642:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.913678:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc2ce2a7/0x5564f2c20ac20d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913687:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.913690:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.913695:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc2ce2a7/0x5564f2c20ac20d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913705:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc2ce2a7/0x5564f2c20ac20d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913713:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc2ce2a7/0x5564f2c20ac20d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913719:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc2ce2a7/0x5564f2c20ac20d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.913740:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786100711.913826:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786100711.913833:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc2ce2a7/0x5564f2c20ac20d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.913852:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100711.913856:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc2ce2a7/0x5564f2c20ac20d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.913864:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc2ce2a7/0x5564f2c20ac20d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.913876:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc2ce2a7/0x5564f2c20ac20d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.913883:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc2ce2a7/0x5564f2c20ac20d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100711.913896:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100711.913897:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786100711.913899:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786100711.915069:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.915079:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac20dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.915103:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.915576:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.915584:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac20dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.915598:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac20dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.915606:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac20dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.915614:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac20dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.915702:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786100711.916139:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786100711.916146:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003799a80c/0x5564f2c20ac20e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.916155:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1786100711.916158:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100711.916163:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003799a80c/0x5564f2c20ac20e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.916172:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003799a80c/0x5564f2c20ac20e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.916192:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003799a80c/0x5564f2c20ac20e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100711.916198:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003799a80c/0x5564f2c20ac20e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100711.919571:0:16021:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786100711.919586:0:16021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac20dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100711.919601:0:16021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896a00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100711.919605:0:16021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac20dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100711.919616:0:16021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac20dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100711.919643:0:16021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac20dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100711.919666:0:16021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab1498ae/0x5564f2c20ac20dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100711.919693:0:16021:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786100711.919697:0:16021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003799a80c/0x5564f2c20ac20e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100711.919703:0:16021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897000 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100711.919705:0:16021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003799a80c/0x5564f2c20ac20e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100711.919724:0:16021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003799a80c/0x5564f2c20ac20e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100711.919735:0:16021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003799a80c/0x5564f2c20ac20e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100711.919743:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100711.919744:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100711.919746:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786100711.919819:0:15012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786100711.919828:0:15012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003799a80c/0x5564f2c20ac20e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1786100711.920202:0:15012:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1786100711.920303:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14353:x1872861960702336:12345-0@lo:5:osp-pre-1-0.0 Request processed in 71169us (71528us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100711.920313:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786100711.920366:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14353:1872861960702336:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1786100711.920380:0:14353:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1786100711.920425:0:14353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14353:1872861960702464:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1786100711.920541:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100711.920568:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100711.920612:0:14353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c50c596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100711.920628:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960702464 00000100:00100000:1.0:1786100711.920633:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960702464 00000100:00100000:2.0:1786100711.920788:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786100711.920801:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14353:x1872861960702464:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1786100711.920838:0:15011:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1786100711.924931:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14353:x1872861960702464:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4128us (4466us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1786100711.924945:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786100711.926893:0:14353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14353:1872861960702464:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1786100711.926911:0:14353:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00100000:2.0:1786100712.469516:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1786100712.469532:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:02000400:1.0:1786100712.737023:0:16084:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg653-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1786100712.869742:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786100713.893572:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100714.793116:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100714.796796:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941832832 00000100:00100000:0.0:1786100714.796811:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941832832 00000100:00100000:0.0:1786100714.797386:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 75 00000100:00100000:0.0:1786100714.797394:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1872861941832832:12345-192.168.206.53@tcp:250:mount.lustre.0 00010000:00080000:0.0:1786100714.797420:0:14323:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 1995a8cb-3604-41be-a0eb-37e324c5086a@192.168.206.53@tcp t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:0.0:1786100714.797448:0:14323:0:(genops.c:1406:class_connect()) connect: client 1995a8cb-3604-41be-a0eb-37e324c5086a, cookie 0x5564f2c20ac20ea 00000100:00080000:0.0:1786100714.797573:0:14323:0:(import.c:65:import_set_state_nolock()) ffff9a3b42542800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786100714.798422:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+5:2350:x1872861941832832:12345-192.168.206.53@tcp:250:mount.lustre.0 Request processed in 1022us (5309us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100714.798432:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 75 00000100:00100000:0.0:1786100714.813443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100714.822078:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941832960 00000100:00100000:3.0:1786100714.822096:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941832960 00000100:00100000:3.0:1786100714.822446:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:3.0:1786100714.822458:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+5:13745:x1872861941832960:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1786100714.822475:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100714.822493:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac20f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3292 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100714.822523:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac20f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3292 expref: 6 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100714.822534:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa98600/0x5564f2c20ac20f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3292 expref: 6 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100714.822544:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98600, rc 0) 00000100:00100000:3.0:1786100714.822634:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+6:13745:x1872861941832960:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 178us (9201us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100714.822643:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 76 00000100:00100000:1.0:1786100714.829486:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100714.830249:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941833088 00000100:00100000:3.0:1786100714.830260:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941833088 00000100:00100000:3.0:1786100714.830334:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00100000:3.0:1786100714.830343:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+6:13745:x1872861941833088:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1786100714.831016:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+6:13745:x1872861941833088:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 670us (1533us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786100714.831026:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 77 00000100:00100000:1.0:1786100714.848403:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100714.864084:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941833216 00000100:00100000:3.0:1786100714.864099:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941833216 00000100:00100000:2.0:1786100714.864337:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 78 00000100:00100000:2.0:1786100714.864348:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+6:13745:x1872861941833216:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786100714.864368:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100714.864386:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7f51f000/0x5564f2c20ac20f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3299 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100714.864417:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7f51f000/0x5564f2c20ac20f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3299 expref: 7 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100714.864428:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7f51f000/0x5564f2c20ac20f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3299 expref: 7 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100714.864436:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f000, rc 0) 00000100:00100000:2.0:1786100714.864508:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+7:13745:x1872861941833216:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 161us (16112us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100714.864515:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 78 00000100:00100000:1.0:1786100714.866120:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100714.866254:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941833344 00000100:00100000:3.0:1786100714.866272:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941833344 00000100:00100000:3.0:1786100714.866322:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 79 00000100:00100000:3.0:1786100714.866332:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+7:13745:x1872861941833344:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1786100714.866593:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+8:13745:x1872861941833344:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 261us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100714.866601:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 79 00000100:00100000:3.0:1786100714.869220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100714.869333:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941833472 00000100:00100000:1.0:1786100714.869345:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941833472 00000100:00100000:1.0:1786100714.869423:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:1.0:1786100714.869433:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+8:13745:x1872861941833472:12345-192.168.206.53@tcp:503:mount.lustre.0 00000100:00100000:1.0:1786100714.870072:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+8:13745:x1872861941833472:12345-192.168.206.53@tcp:503:mount.lustre.0 Request processed in 637us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100714.870080:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 80 00000100:00100000:1.0:1786100714.880194:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100714.880310:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941833600 00000100:00100000:2.0:1786100714.880323:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941833600 00000100:00100000:2.0:1786100714.880386:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:2.0:1786100714.880397:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+8:13764:x1872861941833600:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786100714.881693:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+8:13764:x1872861941833600:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 1290us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100714.881706:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 81 00000100:00100000:0.0:1786100714.904352:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100714.904499:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941833728 00000100:00100000:3.0:1786100714.904513:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941833728 00000100:00100000:3.0:1786100714.904578:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 82 00000100:00100000:3.0:1786100714.904589:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7be98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+8:13764:x1872861941833728:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786100714.905181:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7be98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+8:13764:x1872861941833728:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 589us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100714.905203:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 82 00000100:00100000:3.0:1786100714.914115:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100714.919327:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941833856 00000100:00100000:2.0:1786100714.919348:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941833856 00000100:00100000:2.0:1786100714.919484:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 83 00000100:00100000:2.0:1786100714.919495:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+8:13745:x1872861941833856:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786100714.919531:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100714.919554:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7f51f800/0x5564f2c20ac20ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c32c3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100714.919592:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7f51f800/0x5564f2c20ac20ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32c3 expref: 9 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100714.919605:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7f51f800/0x5564f2c20ac20ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32c3 expref: 9 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100714.919615:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51f800, rc 0) 00000100:00100000:2.0:1786100714.919699:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+9:13745:x1872861941833856:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 206us (5599us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100714.919706:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 83 00000100:00100000:3.0:1786100714.919905:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786100714.919931:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960702592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100714.920187:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100714.920318:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960702592 00000100:00100000:2.0:1786100714.920324:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960702592 00000100:00100000:2.0:1786100714.920374:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786100714.920383:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960702592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786100714.920417:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100714.920460:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960702592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100714.920467:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786100714.920545:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960702592:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786100714.920631:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786100714.922311:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786100714.927750:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100714.927867:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941833984 00000100:00100000:1.0:1786100714.927880:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941833984 00000100:00100000:1.0:1786100714.927945:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 84 00000100:00100000:1.0:1786100714.927958:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+9:13745:x1872861941833984:12345-192.168.206.53@tcp:256:mount.lustre.0 20000000:01000000:1.0:1786100714.928098:0:14323:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1786100714.928131:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1786100714.928136:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1786100714.928140:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1786100714.928143:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1786100714.930384:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+9:13745:x1872861941833984:12345-192.168.206.53@tcp:256:mount.lustre.0 Request processed in 2413us (2632us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100714.930402:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 84 00000100:00100000:3.0:1786100714.934211:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100714.934379:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941834112 00000100:00100000:0.0:1786100714.934392:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941834112 00000100:00100000:0.0:1786100714.934512:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00100000:0.0:1786100714.934524:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+9:13745:x1872861941834112:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786100714.934546:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100714.934569:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac2106 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c32ca expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100714.934605:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac2106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32ca expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100714.934643:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac2106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32ca expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100714.934696:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb400, rc 0) 00000100:00100000:0.0:1786100714.934767:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+10:13745:x1872861941834112:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 245us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100714.934775:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 85 00000100:00100000:1.0:1786100714.938774:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100714.939519:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941834240 00000100:00100000:2.0:1786100714.939531:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941834240 00000100:00100000:2.0:1786100714.939591:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 86 00000100:00100000:2.0:1786100714.939602:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+10:13745:x1872861941834240:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786100714.940406:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+10:13745:x1872861941834240:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 654us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100714.940419:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 86 00000100:00100000:1.0:1786100714.943517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100714.943596:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941834368 00000100:00100000:0.0:1786100714.943608:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941834368 00000100:00100000:0.0:1786100714.943772:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 87 00000100:00100000:0.0:1786100714.943784:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+10:13745:x1872861941834368:12345-192.168.206.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1786100714.944498:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+10:13745:x1872861941834368:12345-192.168.206.53@tcp:503:mount.lustre.0 Request processed in 711us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100714.944509:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 87 00000100:00100000:1.0:1786100714.949347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100714.950619:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941834496 00000100:00100000:3.0:1786100714.950780:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941834496 00000100:00100000:3.0:1786100714.951087:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 88 00000100:00100000:3.0:1786100714.951101:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+10:13769:x1872861941834496:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786100714.951564:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+10:13769:x1872861941834496:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 464us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100714.951573:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 88 00000100:00100000:1.0:1786100714.966843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100714.966948:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941834624 00000100:00100000:2.0:1786100714.966961:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941834624 00000100:00100000:2.0:1786100714.967022:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 89 00000100:00100000:2.0:1786100714.967035:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+10:13769:x1872861941834624:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786100714.968017:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+10:13769:x1872861941834624:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 975us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100714.968031:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 89 00000100:00100000:1.0:1786100714.973924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100714.974190:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941834752 00000100:00100000:3.0:1786100714.974204:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941834752 00000100:00100000:3.0:1786100714.974330:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:3.0:1786100714.974341:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1872861941834752:12345-192.168.206.53@tcp:38:mount.lustre.0 00010000:00080000:3.0:1786100714.974381:0:14330:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from b75cc12d-1273-459a-9324-4254023794ea@192.168.206.53@tcp t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:3.0:1786100714.974501:0:14330:0:(genops.c:1406:class_connect()) connect: client b75cc12d-1273-459a-9324-4254023794ea, cookie 0x5564f2c20ac210d 00000004:00100000:3.0:1786100714.974605:0:14330:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1786100714.974613:0:14330:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1786100715.044809:0:14330:0:(import.c:65:import_set_state_nolock()) ffff9a3b41223800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786100715.044895:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+6:2350:x1872861941834752:12345-192.168.206.53@tcp:38:mount.lustre.0 Request processed in 70555us (70985us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100715.044923:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:1.0:1786100715.049090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100715.049231:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100715.054701:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941834880 00000100:00100000:2.0:1786100715.054717:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941834880 00000100:00100000:2.0:1786100715.054875:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941835008 00000100:00100000:2.0:1786100715.054879:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941835008 00000100:00100000:2.0:1786100715.054904:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:2.0:1786100715.054914:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+7:0:x1872861941834880:12345-192.168.206.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1786100715.054957:0:14328:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786100715.055063:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+7:0:x1872861941834880:12345-192.168.206.53@tcp:41:mount.lustre.0 Request processed in 150us (5984us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100715.055070:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:2.0:1786100715.055089:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:2.0:1786100715.055097:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+6:13745:x1872861941835008:12345-192.168.206.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1786100715.055110:0:14328:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786100715.055135:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+6:13745:x1872861941835008:12345-192.168.206.53@tcp:41:mount.lustre.0 Request processed in 39us (5904us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100715.055158:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00080000:1.0:1786100715.055395:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786100715.060844:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100715.060919:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941835136 00000100:00100000:2.0:1786100715.060929:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941835136 00000100:00100000:2.0:1786100715.060982:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:2.0:1786100715.060992:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+6:13745:x1872861941835136:12345-192.168.206.53@tcp:40:mount.lustre.0 00000100:00100000:2.0:1786100715.061211:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+6:13745:x1872861941835136:12345-192.168.206.53@tcp:40:mount.lustre.0 Request processed in 219us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100715.061219:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:1.0:1786100715.067130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100715.067250:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941835264 00000100:00100000:3.0:1786100715.067274:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941835264 00000100:00100000:3.0:1786100715.067326:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:3.0:1786100715.067335:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1872861941835264:12345-192.168.206.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1786100715.067370:0:15737:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from b75cc12d-1273-459a-9324-4254023794ea@192.168.206.53@tcp t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:3.0:1786100715.067401:0:15737:0:(genops.c:1406:class_connect()) connect: client b75cc12d-1273-459a-9324-4254023794ea, cookie 0x5564f2c20ac2114 00002000:00100000:3.0:1786100715.067412:0:15737:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b75cc12d-1273-459a-9324-4254023794ea/ffff9a3b41221800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786100715.067422:0:15737:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786100715.067832:0:15737:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1786100715.067868:0:15737:0:(import.c:65:import_set_state_nolock()) ffff9a3b41225000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786100715.067936:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b75cc12d-1273-459a-9324-4254023794ea+6:2350:x1872861941835264:12345-192.168.206.53@tcp:8:mount.lustre.0 Request processed in 601us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100715.067944:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:2.0:1786100715.079955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100715.080018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100715.080222:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941835392 00000100:00100000:0.0:1786100715.080233:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941835392 00000100:00100000:0.0:1786100715.080296:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:0.0:1786100715.080305:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1872861941835392:12345-192.168.206.53@tcp:8:mount.lustre.0 00010000:00080000:0.0:1786100715.080338:0:15012:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from b75cc12d-1273-459a-9324-4254023794ea@192.168.206.53@tcp t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:0.0:1786100715.080367:0:15012:0:(genops.c:1406:class_connect()) connect: client b75cc12d-1273-459a-9324-4254023794ea, cookie 0x5564f2c20ac211b 00002000:00100000:0.0:1786100715.080379:0:15012:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b75cc12d-1273-459a-9324-4254023794ea/ffff9a3b42546000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786100715.080400:0:15012:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786100715.080756:0:15012:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786100715.080786:0:15012:0:(import.c:65:import_set_state_nolock()) ffff9a3b42542000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786100715.081014:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b75cc12d-1273-459a-9324-4254023794ea+6:2350:x1872861941835392:12345-192.168.206.53@tcp:8:mount.lustre.0 Request processed in 706us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100715.081022:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:3.0:1786100715.082938:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941835520 00000100:00100000:3.0:1786100715.082952:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941835520 00000100:00100000:3.0:1786100715.083011:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:3.0:1786100715.083021:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b75cc12d-1273-459a-9324-4254023794ea+6:13745:x1872861941835520:12345-192.168.206.53@tcp:33:mount.lustre.0 00000004:00080000:3.0:1786100715.084128:0:14331:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1041us 00000004:00200000:3.0:1786100715.103375:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1786100715.103567:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b75cc12d-1273-459a-9324-4254023794ea+6:13745:x1872861941835520:12345-192.168.206.53@tcp:33:mount.lustre.0 Request processed in 20540us (23542us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100715.103578:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:2.0:1786100715.381794:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100715.383137:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941835648 00000100:00100000:1.0:1786100715.383150:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941835648 00000100:00100000:1.0:1786100715.383223:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:1.0:1786100715.383234:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+6:13791:x1872861941835648:12345-192.168.206.53@tcp:101:mkdir.0 00010000:00010000:1.0:1786100715.383254:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100715.383292:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac2122 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c32f4 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100715.383355:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac2129 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100715.383368:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac2129 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100715.383381:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac2129 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100715.383582:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786100715.383586:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100715.383713:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac2129 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100715.383741:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac2122 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32f4 expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100715.383765:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac2129 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32f4 expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100715.383774:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a300) 00010000:00010000:1.0:1786100715.383777:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100715.383780:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3b41896000, rc 0) 00000100:00100000:1.0:1786100715.383849:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+7:13791:x1872861941835648:12345-192.168.206.53@tcp:101:mkdir.0 Request processed in 617us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100715.383856:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00010000:00010000:2.0:1786100715.943019:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100716.965410:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960702720:0@lo:400:kworker.0 00000100:00100000:1.0:1786100716.965430:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960702976:0@lo:400:kworker.0 00000100:00100000:2.0:1786100716.965548:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960703104:0@lo:400:kworker.0 00010000:00010000:3.0:1786100716.965785:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100716.965810:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960702848:0@lo:400:kworker.0 00000100:00100000:0.0:1786100716.967330:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100716.967331:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100716.967410:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1872861960703232:0@lo:400:kworker.0 00000100:00100000:0.0:1786100716.967447:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100716.967504:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960702720 00000100:00100000:0.0:1786100716.967511:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960702720 00000100:00100000:0.0:1786100716.967556:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1786100716.967565:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:3308:x1872861960702720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100716.967615:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:3308:x1872861960702720:12345-0@lo:400:kworker.0 Request processed in 51us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100716.967622:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1786100716.967679:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960702976 00000100:00100000:0.0:1786100716.967684:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960702976 00000100:00100000:0.0:1786100716.967721:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786100716.967728:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960702976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100716.967760:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960702976:12345-0@lo:400:kworker.0 Request processed in 32us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100716.967766:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786100716.967891:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960702720:0@lo:400:kworker.0 00000100:00080000:0.0:1786100716.967924:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786100716.967943:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960703232 00000100:00100000:0.0:1786100716.967946:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960703232 00000100:00100000:0.0:1786100716.968134:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786100716.968274:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872861960703232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100716.968317:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872861960703232:12345-0@lo:400:kworker.0 Request processed in 46us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100716.968323:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1786100716.968339:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100716.968362:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1872861960703232:0@lo:400:kworker.0 00000100:00100000:1.0:1786100716.971712:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1786100716.971742:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960702976:0@lo:400:kworker.0 00000100:00100000:1.0:1786100716.971771:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960703488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100716.971832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100716.972233:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960703488 00000100:00100000:0.0:1786100716.972240:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960703488 00000100:00100000:0.0:1786100716.972352:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786100716.972363:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960703488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786100716.972396:0:15013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786100716.972450:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960703488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100716.972457:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786100716.974138:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100716.974243:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960703488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786100716.974284:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960703104 00000100:00100000:2.0:1786100716.974289:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960703104 00000100:00100000:2.0:1786100716.974326:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786100716.974332:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960703104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100716.974373:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960703104:12345-0@lo:400:kworker.0 Request processed in 41us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100716.974378:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786100716.974404:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960703104:0@lo:400:kworker.0 00000100:00100000:3.0:1786100716.980437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100716.980706:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960703360:0@lo:400:kworker.0 00000100:00100000:3.0:1786100716.980747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100716.980997:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960702848 00000100:00100000:2.0:1786100716.981017:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960702848 00000100:00100000:2.0:1786100716.981114:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786100716.981124:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960702848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100716.981182:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960703360 00000100:00100000:2.0:1786100716.981185:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960702848:12345-0@lo:400:kworker.0 Request processed in 61us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100716.981189:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960703360 00000100:00100000:2.0:1786100716.981197:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786100716.981272:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960702848:0@lo:400:kworker.0 00000100:00080000:1.0:1786100716.981291:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786100716.981297:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786100716.981322:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786100716.981329:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1872861960703360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100716.981376:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1872861960703360:12345-0@lo:400:kworker.0 Request processed in 47us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100716.981382:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786100716.981456:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960703360:0@lo:400:kworker.0 00000100:00100000:1.0:1786100717.445750:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100717.454155:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941835776 00000100:00100000:2.0:1786100717.454167:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941835776 00000100:00100000:2.0:1786100717.454262:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:2.0:1786100717.454275:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+7:13843:x1872861941835776:12345-192.168.206.53@tcp:41:lfs.0 00000004:00000024:2.0:1786100717.454314:0:14328:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786100717.454411:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+7:13843:x1872861941835776:12345-192.168.206.53@tcp:41:lfs.0 Request processed in 138us (8670us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100717.454419:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00080000:1.0:1786100717.454572:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100717.465766:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100717.465952:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941835904 00000100:00100000:1.0:1786100717.465962:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941835904 00000100:00100000:1.0:1786100717.466091:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:1.0:1786100717.466102:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b75cc12d-1273-459a-9324-4254023794ea+6:13843:x1872861941835904:12345-192.168.206.53@tcp:13:lfs.0 00002000:00000024:1.0:1786100717.466155:0:15014:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100717.466241:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b75cc12d-1273-459a-9324-4254023794ea+6:13843:x1872861941835904:12345-192.168.206.53@tcp:13:lfs.0 Request processed in 140us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100717.466259:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00080000:0.0:1786100717.467684:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786100717.475017:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100717.475234:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941836032 00000100:00100000:1.0:1786100717.475244:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941836032 00000100:00100000:1.0:1786100717.475319:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:1.0:1786100717.475332:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b75cc12d-1273-459a-9324-4254023794ea+6:13843:x1872861941836032:12345-192.168.206.53@tcp:13:lfs.0 00002000:00000024:1.0:1786100717.475359:0:15014:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100717.475443:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b75cc12d-1273-459a-9324-4254023794ea+6:13843:x1872861941836032:12345-192.168.206.53@tcp:13:lfs.0 Request processed in 114us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100717.475450:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00080000:0.0:1786100717.475558:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1786100717.541394:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b75cc12d-1273-459a-9324-4254023794ea 00000100:00100000:3.0:1786100717.675736:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100717.676362:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941836160 00000100:00100000:0.0:1786100717.676372:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941836160 00000100:00100000:0.0:1786100717.676432:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 91 00000100:00100000:0.0:1786100717.676442:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+10:13873:x1872861941836160:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786100717.676458:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100717.676475:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbba800/0x5564f2c20ac2130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c32fb expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100717.676502:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbba800/0x5564f2c20ac2130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32fb expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100717.676527:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbba800/0x5564f2c20ac2130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32fb expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100717.676537:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbba800, rc 0) 00000100:00100000:0.0:1786100717.676598:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+11:13873:x1872861941836160:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 157us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100717.676606:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 91 00000100:00100000:3.0:1786100717.684738:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100717.684957:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941836288 00000100:00100000:0.0:1786100717.684971:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941836288 00000100:00100000:0.0:1786100717.685096:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 92 00000100:00100000:0.0:1786100717.685106:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+11:13873:x1872861941836288:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1786100717.689353:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+11:13873:x1872861941836288:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 4232us (4612us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100717.689368:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 92 00000100:00100000:0.0:1786100717.712034:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100717.712155:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941836416 00000100:00100000:3.0:1786100717.712164:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941836416 00000100:00100000:3.0:1786100717.712218:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 93 00000100:00100000:3.0:1786100717.712229:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+11:13873:x1872861941836416:12345-192.168.206.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1786100717.712750:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+11:13873:x1872861941836416:12345-192.168.206.53@tcp:503:mount.lustre.0 Request processed in 520us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100717.712759:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 93 00000100:00100000:1.0:1786100717.730968:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100717.731055:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941836544 00000100:00100000:0.0:1786100717.731065:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941836544 00000100:00100000:0.0:1786100717.731119:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 94 00000100:00100000:0.0:1786100717.731129:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+11:13881:x1872861941836544:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786100717.731500:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+11:13881:x1872861941836544:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 370us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100717.731509:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 94 00000100:00100000:2.0:1786100717.773276:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100717.773511:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941836672 00000100:00100000:0.0:1786100717.773520:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941836672 00000100:00100000:0.0:1786100717.773572:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 95 00000100:00100000:0.0:1786100717.773593:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+11:13881:x1872861941836672:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786100717.773871:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+11:13881:x1872861941836672:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 278us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100717.773880:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 95 00000100:00100000:2.0:1786100717.779833:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100717.780212:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941836800 00000100:00100000:3.0:1786100717.780221:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941836800 00000100:00100000:3.0:1786100717.780338:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 96 00000100:00100000:3.0:1786100717.780348:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+11:13873:x1872861941836800:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1786100717.780365:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100717.780382:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa99e00/0x5564f2c20ac2137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3325 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100717.780422:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa99e00/0x5564f2c20ac2137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3325 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100717.780434:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa99e00/0x5564f2c20ac2137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3325 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100717.780442:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99e00, rc 0) 00000100:00100000:3.0:1786100717.780498:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+12:13873:x1872861941836800:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 152us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100717.780505:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 96 00000100:00100000:1.0:1786100717.794060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100717.795546:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941836928 00000100:00100000:2.0:1786100717.795559:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941836928 00000100:00100000:2.0:1786100717.795627:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 97 00000100:00100000:2.0:1786100717.795637:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+12:13873:x1872861941836928:12345-192.168.206.53@tcp:256:mount.lustre.0 20000000:01000000:2.0:1786100717.795697:0:14321:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1786100717.795719:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1786100717.795723:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1786100717.795727:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1786100717.795730:0:14321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1786100717.798099:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+12:13873:x1872861941836928:12345-192.168.206.53@tcp:256:mount.lustre.0 Request processed in 2447us (4034us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100717.798117:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 97 00000100:00100000:0.0:1786100717.801108:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100717.801214:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941837056 00000100:00100000:3.0:1786100717.801227:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941837056 00000100:00100000:3.0:1786100717.801306:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 98 00000100:00100000:3.0:1786100717.801318:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6e0f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+12:13873:x1872861941837056:12345-192.168.206.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1786100717.801341:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100717.801365:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac213e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c332c expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100717.801402:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac213e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c332c expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100717.801415:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac213e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c332c expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100717.801426:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99400, rc 0) 00000100:00100000:3.0:1786100717.801499:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6e0f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13873:x1872861941837056:12345-192.168.206.53@tcp:101:mount.lustre.0 Request processed in 183us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100717.801527:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 98 00000100:00100000:1.0:1786100717.807315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100717.807531:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941837184 00000100:00100000:0.0:1786100717.807543:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941837184 00000100:00100000:0.0:1786100717.807608:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 99 00000100:00100000:0.0:1786100717.807620:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13873:x1872861941837184:12345-192.168.206.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1786100717.808042:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13873:x1872861941837184:12345-192.168.206.53@tcp:501:mount.lustre.0 Request processed in 423us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100717.808051:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 99 00000100:00100000:2.0:1786100717.814083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100717.814280:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941837312 00000100:00100000:0.0:1786100717.814292:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941837312 00000100:00100000:0.0:1786100717.814358:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 100 00000100:00100000:0.0:1786100717.814369:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13873:x1872861941837312:12345-192.168.206.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1786100717.815099:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13873:x1872861941837312:12345-192.168.206.53@tcp:503:mount.lustre.0 Request processed in 729us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100717.815110:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 100 00000100:00100000:2.0:1786100717.818290:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100717.818463:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941837440 00000100:00100000:3.0:1786100717.818477:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941837440 00000100:00100000:3.0:1786100717.818546:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 101 00000100:00100000:3.0:1786100717.818559:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13887:x1872861941837440:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786100717.819090:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13887:x1872861941837440:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 531us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100717.819100:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 101 00000100:00100000:1.0:1786100717.834714:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100717.837883:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941837568 00000100:00100000:2.0:1786100717.837904:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941837568 00000100:00100000:2.0:1786100717.838005:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 102 00000100:00100000:2.0:1786100717.838017:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13887:x1872861941837568:12345-192.168.206.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786100717.838447:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13887:x1872861941837568:12345-192.168.206.53@tcp:502:llog_process_th.0 Request processed in 429us (3746us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100717.838456:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 102 00000100:00100000:2.0:1786100717.846945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100717.847145:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941837696 00000100:00100000:0.0:1786100717.847159:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941837696 00000100:00100000:0.0:1786100717.847231:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:0.0:1786100717.847273:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1872861941837696:12345-192.168.206.53@tcp:38:mount.lustre.0 00010000:00080000:0.0:1786100717.847318:0:14330:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c@192.168.206.53@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1786100717.847366:0:14330:0:(genops.c:1406:class_connect()) connect: client 7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c, cookie 0x5564f2c20ac2145 00000004:00100000:0.0:1786100717.847403:0:14330:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1786100717.847562:0:14330:0:(import.c:65:import_set_state_nolock()) ffff9a3b42547800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786100717.849635:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:2350:x1872861941837696:12345-192.168.206.53@tcp:38:mount.lustre.0 Request processed in 2341us (2681us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100717.849665:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:0.0:1786100717.852899:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100717.852991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100717.853861:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941837824 00000100:00100000:3.0:1786100717.853875:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941837824 00000100:00080000:0.0:1786100717.853972:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100717.854182:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941837952 00000100:00100000:2.0:1786100717.854187:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941837952 00000100:00100000:2.0:1786100717.854298:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:2.0:1786100717.854311:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+7:0:x1872861941837824:12345-192.168.206.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1786100717.854371:0:14328:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786100717.854474:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+7:0:x1872861941837824:12345-192.168.206.53@tcp:41:mount.lustre.0 Request processed in 165us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100717.854481:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:2.0:1786100717.854502:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:2.0:1786100717.854509:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:13873:x1872861941837952:12345-192.168.206.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1786100717.854521:0:14328:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786100717.854543:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:13873:x1872861941837952:12345-192.168.206.53@tcp:41:mount.lustre.0 Request processed in 35us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100717.854550:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:1.0:1786100717.856417:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100717.856537:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941838080 00000100:00100000:3.0:1786100717.856548:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941838080 00000100:00100000:3.0:1786100717.856832:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:3.0:1786100717.856845:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:13873:x1872861941838080:12345-192.168.206.53@tcp:40:mount.lustre.0 00000100:00100000:3.0:1786100717.856947:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:13873:x1872861941838080:12345-192.168.206.53@tcp:40:mount.lustre.0 Request processed in 105us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100717.856954:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:1.0:1786100717.860412:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100717.861394:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941838208 00000100:00100000:0.0:1786100717.861409:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941838208 00000100:00100000:0.0:1786100717.861475:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:0.0:1786100717.861486:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1872861941838208:12345-192.168.206.53@tcp:8:mount.lustre.0 00010000:00080000:0.0:1786100717.861529:0:15737:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c@192.168.206.53@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1786100717.861571:0:15737:0:(genops.c:1406:class_connect()) connect: client 7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c, cookie 0x5564f2c20ac214c 00002000:00100000:0.0:1786100717.861587:0:15737:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c/ffff9a3b42540800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786100717.861601:0:15737:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786100717.861792:0:15737:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1786100717.862188:0:15737:0:(import.c:65:import_set_state_nolock()) ffff9a3b42546800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786100717.862349:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:2350:x1872861941838208:12345-192.168.206.53@tcp:8:mount.lustre.0 Request processed in 862us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100717.862358:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:0.0:1786100717.864038:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100717.864145:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941838336 00000100:00100000:3.0:1786100717.864159:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941838336 00000100:00100000:3.0:1786100717.864209:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:3.0:1786100717.864218:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1872861941838336:12345-192.168.206.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1786100717.864267:0:15012:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c@192.168.206.53@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:3.0:1786100717.864313:0:15012:0:(genops.c:1406:class_connect()) connect: client 7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c, cookie 0x5564f2c20ac2153 00002000:00100000:3.0:1786100717.864328:0:15012:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c/ffff9a3b41223000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786100717.864350:0:15012:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786100717.864635:0:15012:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786100717.864699:0:15012:0:(import.c:65:import_set_state_nolock()) ffff9a3b41227000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786100717.864768:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:2350:x1872861941838336:12345-192.168.206.53@tcp:8:mount.lustre.0 Request processed in 551us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100717.864776:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:1.0:1786100717.866982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100717.867105:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941838464 00000100:00100000:2.0:1786100717.867119:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941838464 00000100:00100000:2.0:1786100717.867195:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:2.0:1786100717.867217:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:13873:x1872861941838464:12345-192.168.206.53@tcp:33:mount.lustre.0 00000004:00200000:2.0:1786100717.867578:0:14332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1786100717.867781:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:13873:x1872861941838464:12345-192.168.206.53@tcp:33:mount.lustre.0 Request processed in 576us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100717.867790:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00010000:00010000:1.0:1786100717.990035:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100718.041724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100718.043421:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941838592 00000100:00100000:2.0:1786100718.043440:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941838592 00000100:00100000:0.0:1786100718.043682:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:0.0:1786100718.043698:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:13908:x1872861941838592:12345-192.168.206.53@tcp:101:mkdir.0 00010000:00010000:0.0:1786100718.043724:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100718.043755:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac215a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3356 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100718.043909:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2161 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100718.043926:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100718.043942:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100718.044605:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786100718.044612:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1786100718.044725:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100718.044758:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbba400/0x5564f2c20ac215a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3356 expref: 8 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100718.044776:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2161 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3356 expref: 7 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100718.044786:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a300) 00010000:00010000:0.0:1786100718.044790:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786100718.044794:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbba00, rc 0) 00000100:00100000:1.0:1786100718.045750:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+7:13908:x1872861941838592:12345-192.168.206.53@tcp:101:mkdir.0 Request processed in 2045us (4028us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100718.045763:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00000001:00100000:1.0:1786100718.119619:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c 00000001:00100000:1.0:1786100718.119695:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b75cc12d-1273-459a-9324-4254023794ea 00010000:00010000:2.0:1786100719.012838:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100720.037835:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786100720.037881:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c473d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960703616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786100720.037983:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100720.038295:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960703616 00000100:00100000:2.0:1786100720.038304:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960703616 00000100:00100000:2.0:1786100720.038381:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786100720.038393:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960703616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786100720.038435:0:15014:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100720.038492:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960703616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100720.038499:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1786100720.039792:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786100720.043156:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786100720.043461:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c473d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960703616:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1786100720.151705:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c 00000001:00100000:0.0:1786100720.151728:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b75cc12d-1273-459a-9324-4254023794ea 00000001:02000400:3.0:1786100720.955558:0:16286:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1786100721.061057:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786100721.511073:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1786100722.086306:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100722.086794:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786100722.086820:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960703744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786100722.086902:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100722.086979:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960703744 00000100:00100000:1.0:1786100722.086988:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960703744 00000100:00100000:1.0:1786100722.087076:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786100722.087087:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960703744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100722.087128:0:15014:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100722.087184:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960703744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100722.087192:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1786100722.087216:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786100722.087265:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960703744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786100722.087493:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960704000:0@lo:400:kworker.0 00000100:00100000:3.0:1786100722.087540:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100722.087570:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786100722.087576:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0af484e0-17d7-4fef-8244-23d93563e204:3306:1872861960703872:0@lo:400:kworker.0 00000100:00100000:3.0:1786100722.087603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100722.087620:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1872861960704384:0@lo:400:kworker.0 00000100:00100000:3.0:1786100722.087640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100722.087688:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960704000 00000100:00100000:3.0:1786100722.087692:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960704000 00000100:00100000:3.0:1786100722.087728:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786100722.087734:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960704000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100722.087768:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960704000:12345-0@lo:400:kworker.0 Request processed in 35us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100722.087775:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786100722.087793:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960703872 00000100:00100000:3.0:1786100722.087795:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960703872 00000100:00100000:3.0:1786100722.087817:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1786100722.087823:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:3306:x1872861960703872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100722.087867:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:3306:x1872861960703872:12345-0@lo:400:kworker.0 Request processed in 44us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100722.087873:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1786100722.087899:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960704384 00000100:00100000:3.0:1786100722.087902:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960704384 00000100:00100000:3.0:1786100722.087928:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786100722.087933:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1872861960704384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100722.087959:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1872861960704384:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100722.087965:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786100722.087996:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0af484e0-17d7-4fef-8244-23d93563e204:3306:1872861960703872:0@lo:400:kworker.0 00000100:00100000:3.0:1786100722.088005:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1872861960704384:0@lo:400:kworker.0 00000100:00100000:3.0:1786100722.088012:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960704000:0@lo:400:kworker.0 00000100:00100000:0.0:1786100722.088554:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1872861960704256:0@lo:400:kworker.0 00000100:00100000:0.0:1786100722.088614:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100722.088691:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786100722.088699:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960704128:0@lo:400:kworker.0 00000100:00100000:0.0:1786100722.088731:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100722.088935:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960704256 00000100:00100000:3.0:1786100722.088943:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960704256 00000100:00100000:3.0:1786100722.088988:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960704128 00000100:00100000:3.0:1786100722.088991:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960704128 00000100:00100000:3.0:1786100722.089016:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786100722.089025:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872861960704256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100722.089092:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872861960704256:12345-0@lo:400:kworker.0 Request processed in 68us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100722.089099:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786100722.089114:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786100722.089120:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960704128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100722.089147:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872861960704128:12345-0@lo:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100722.089165:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786100722.089202:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872861960704128:0@lo:400:kworker.0 00000100:00100000:3.0:1786100722.089213:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1872861960704256:0@lo:400:kworker.0 00000100:00080000:1.0:1786100722.089607:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786100722.089614:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1786100722.692361:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c 00010000:00010000:3.0:1786100723.112950:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100723.342431:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100723.342523:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941838720 00000100:00100000:3.0:1786100723.342535:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941838720 00000100:00100000:3.0:1786100723.342597:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 104 00000100:00100000:3.0:1786100723.342608:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+13:2351:x1872861941838720:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100723.342712:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+13:2351:x1872861941838720:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 106us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100723.342721:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 104 00000100:00100000:1.0:1786100723.348785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100723.349105:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100723.349202:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941838976 00000100:00100000:2.0:1786100723.349212:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941838976 00000100:00100000:2.0:1786100723.349302:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:2.0:1786100723.349313:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b75cc12d-1273-459a-9324-4254023794ea+5:2351:x1872861941838976:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100723.349379:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b75cc12d-1273-459a-9324-4254023794ea+5:2351:x1872861941838976:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 68us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100723.349387:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00080000:1.0:1786100723.349514:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786100723.350878:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941838848 00000100:00100000:3.0:1786100723.350891:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941838848 00000100:00100000:3.0:1786100723.351031:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:3.0:1786100723.351042:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+6:2351:x1872861941838848:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100723.351102:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+6:2351:x1872861941838848:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 61us (2326us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100723.351110:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00080000:1.0:1786100723.356340:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786100723.363787:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100723.363830:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100723.363887:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100723.363914:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100723.363945:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941839104 00000100:00100000:2.0:1786100723.363954:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941839104 00000100:00100000:2.0:1786100723.364011:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941839360 00000100:00100000:2.0:1786100723.364014:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941839360 00000100:00100000:2.0:1786100723.364029:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941839488 00000100:00100000:2.0:1786100723.364032:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941839488 00000100:00100000:2.0:1786100723.364047:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:2.0:1786100723.364057:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b75cc12d-1273-459a-9324-4254023794ea+5:2351:x1872861941839104:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100723.364121:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b75cc12d-1273-459a-9324-4254023794ea+5:2351:x1872861941839104:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 65us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100723.364128:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:2.0:1786100723.364144:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:2.0:1786100723.364151:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:2352:x1872861941839360:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100723.364178:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:2352:x1872861941839360:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 28us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100723.364185:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:2.0:1786100723.364196:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:2.0:1786100723.364203:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:2352:x1872861941839488:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100723.364245:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:2352:x1872861941839488:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 42us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100723.364251:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:0.0:1786100723.369011:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941839232 00000100:00100000:0.0:1786100723.369024:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941839232 00000100:00100000:0.0:1786100723.369107:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:0.0:1786100723.369117:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:2352:x1872861941839232:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100723.369183:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:2352:x1872861941839232:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 68us (5296us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100723.369190:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00080000:1.0:1786100723.370336:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786100723.370345:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786100723.370347:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786100724.132771:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786100724.766246:0:16435:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff79724ea0 20000000:00000080:3.0:1786100724.766264:0:16435:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a3c5e843800 uarg=0000000000000000 20000000:01000000:3.0:1786100724.766300:0:16435:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786100724.766307:0:16435:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786100724.766312:0:16435:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1786100724.767631:0:16436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1786100724.768100:0:16435:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1786100724.779339:0:16435:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1786100724.779556:0:16435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.779586:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4165ee00/0x5564f2c20ac1e5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1e58 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.779594:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa99200/0x5564f2c20ac1eac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1ea5 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.779601:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac1fe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac1fe0 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.779610:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac2106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32ca expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.779617:0:16435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac213e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c332c expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.779624:0:16435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.779704:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac213e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c332c expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.779719:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac213e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c332c expref: 12 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100724.779733:0:16435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44767b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1872861960704512:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100724.780058:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac2106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32ca expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.780068:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac2106 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32ca expref: 12 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100724.780084:0:16435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44766d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1872861960704640:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100724.780113:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac1fe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac1fe0 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.780121:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac1fe7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac1fe0 expref: 18 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100724.780130:0:16435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44765c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1872861960704768:0@lo:104: 00000100:00100000:2.0:1786100724.780162:0:16435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786100724.780189:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c7fa99200/0x5564f2c20ac1eac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac1ea5 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.780197:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c7fa99200/0x5564f2c20ac1eac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac1ea5 expref: 18 pid: 14323 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100724.780205:0:16435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44766680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1872861960704896:0@lo:104: 00000100:00100000:2.0:1786100724.780232:0:16435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786100724.780248:0:16435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a3c4165ee00/0x5564f2c20ac1e5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5564f2c20ac1e58 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.780256:0:16435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a3c4165ee00/0x5564f2c20ac1e5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5564f2c20ac1e58 expref: 18 pid: 14323 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100724.780264:0:16435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44767480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1872861960705024:0@lo:104: 00000100:00100000:2.0:1786100724.780283:0:16435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100724.780291:0:16435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583e43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100724.780456:0:14312:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786100724.780469:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960704768 00000100:00100000:0.0:1786100724.780474:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960704768 00000100:00100000:0.0:1786100724.780509:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960704896 00000100:00100000:0.0:1786100724.780511:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960704896 00000100:00100000:0.0:1786100724.780526:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960705024 00000100:00100000:0.0:1786100724.780529:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960705024 00000100:00100000:0.0:1786100724.780539:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786100724.780547:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44765f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0af484e0-17d7-4fef-8244-23d93563e204+5:16435:x1872861960704768:12345-0@lo:104: 00010000:00010000:0.0:1786100724.780558:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1fe7 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.780611:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786100724.780616:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44765f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0af484e0-17d7-4fef-8244-23d93563e204+5:16435:x1872861960704768:12345-0@lo:104: Request processed in 70us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100724.780622:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786100724.780637:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786100724.780643:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0af484e0-17d7-4fef-8244-23d93563e204+4:16435:x1872861960704896:12345-0@lo:104: 00010000:00010000:0.0:1786100724.780674:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1eac expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.780710:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1786100724.780715:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0af484e0-17d7-4fef-8244-23d93563e204+4:16435:x1872861960704896:12345-0@lo:104: Request processed in 73us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100724.780721:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786100724.780734:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786100724.780740:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0af484e0-17d7-4fef-8244-23d93563e204+3:16435:x1872861960705024:12345-0@lo:104: 00010000:00010000:0.0:1786100724.780747:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1e5f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100724.780888:0:16435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44765c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1872861960704768:0@lo:104: 00000100:00100000:2.0:1786100724.780896:0:16435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44766680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1872861960704896:0@lo:104: 00010000:00010000:0.0:1786100724.781027:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1786100724.781033:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0af484e0-17d7-4fef-8244-23d93563e204+3:16435:x1872861960705024:12345-0@lo:104: Request processed in 293us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100724.781047:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1786100724.781080:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786100724.781086:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1fe7 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.781093:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99c00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100724.781098:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac1fe7 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.781106:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac1fe7 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100724.781113:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac1fe7 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100724.781119:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786100724.781144:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1fe7 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.781151:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100724.781169:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1fe7 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.781177:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c7fa99c00/0x5564f2c20ac1fe0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1fe7 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.781188:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786100724.781191:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1eac expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100724.781334:0:16435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44767480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1872861960705024:0@lo:104: 00010000:00010000:0.0:1786100724.782308:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165ec00 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100724.782314:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac1eac expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.782323:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac1eac expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100724.782330:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac1eac expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100724.782336:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786100724.782361:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1eac expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.782367:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100724.782388:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1eac expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.782394:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4165ec00/0x5564f2c20ac1ea5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1eac expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.782406:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100724.782409:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5564f2c20ac1e5f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.782415:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb000 already unused, calling callback (ffffffffc1cabc20) 10000000:00010000:0.0:1786100724.782418:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5564f2c20ac1e5f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.782436:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5564f2c20ac1e5f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786100724.782443:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5564f2c20ac1e5f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786100724.782448:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786100724.782463:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1e5f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.782468:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786100724.782474:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1e5f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.782480:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbbb000/0x5564f2c20ac1e58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5564f2c20ac1e5f expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.782493:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100724.782495:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100724.782497:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100724.782504:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100724.782509:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100724.782531:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0af484e0-17d7-4fef-8244-23d93563e204:3306:1872861960705152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786100724.782581:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100724.782630:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960705408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786100724.782676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100724.782706:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786100724.782711:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960705280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786100724.782746:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100724.782773:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960705152 00000100:00100000:0.0:1786100724.782778:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960705152 00010000:00010000:0.0:1786100724.782803:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac1fe7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1fe0 expref: 19 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100724.782823:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960705408 00000100:00100000:0.0:1786100724.782826:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960705408 00010000:00010000:0.0:1786100724.782837:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4165ee00/0x5564f2c20ac1e5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1e58 expref: 20 pid: 14323 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100724.782847:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960705280 00000100:00100000:0.0:1786100724.782850:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960705280 00010000:00010000:0.0:1786100724.782859:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa99200/0x5564f2c20ac1eac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1ea5 expref: 21 pid: 14323 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100724.782872:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786100724.782879:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0af484e0-17d7-4fef-8244-23d93563e204+21:3306:x1872861960705152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786100724.782891:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100724.782897:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac1fe7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1fe0 expref: 21 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.782905:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac1fe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac1fe0 expref: 21 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.782918:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c62387600/0x5564f2c20ac1fe7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac1fe0 expref: 21 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.782931:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100724.784373:0:14315:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1786100724.784386:0:14315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1786100724.784708:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0af484e0-17d7-4fef-8244-23d93563e204+20:3306:x1872861960705152:12345-0@lo:103:ldlm_bl.0 Request processed in 1825us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100724.784728:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786100724.784754:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786100724.784764:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0af484e0-17d7-4fef-8244-23d93563e204+19:3308:x1872861960705408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786100724.784778:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100724.784786:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4165ee00/0x5564f2c20ac1e5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1e58 expref: 19 pid: 14323 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.784797:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4165ee00/0x5564f2c20ac1e5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac1e58 expref: 19 pid: 14323 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.784812:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4165ee00/0x5564f2c20ac1e5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac1e58 expref: 19 pid: 14323 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100724.784894:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1786100724.784940:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100724.784984:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0af484e0-17d7-4fef-8244-23d93563e204+18:3308:x1872861960705408:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (2307us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100724.785011:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c4811fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0af484e0-17d7-4fef-8244-23d93563e204+18:3308:x1872861960705280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786100724.785023:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100724.785028:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa99200/0x5564f2c20ac1eac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5564f2c20ac1ea5 expref: 18 pid: 14323 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100724.785037:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa99200/0x5564f2c20ac1eac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5564f2c20ac1ea5 expref: 18 pid: 14323 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100724.785427:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa99200/0x5564f2c20ac1eac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5564f2c20ac1ea5 expref: 18 pid: 14323 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100724.785521:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786100724.787188:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0af484e0-17d7-4fef-8244-23d93563e204:3306:1872861960705152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786100724.787260:0:16435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44767b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1872861960704512:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100724.787457:0:16435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44766d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16435:1872861960704640:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100724.787487:0:16435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100724.791342:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100724.791428:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c4811fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0af484e0-17d7-4fef-8244-23d93563e204+16:3308:x1872861960705280:12345-0@lo:103:ldlm_bl.0 Request processed in 6415us (8676us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100724.791441:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786100724.792632:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100724.792686:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100724.793828:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941839744 00000100:00100000:1.0:1786100724.793839:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941839744 00010000:00010000:1.0:1786100724.793881:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac2106 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32ca expref: 13 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100724.793910:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941839616 00000100:00100000:1.0:1786100724.793913:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941839616 00010000:00010000:1.0:1786100724.793925:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac213e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c332c expref: 14 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100724.794067:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:1.0:1786100724.794079:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1995a8cb-3604-41be-a0eb-37e324c5086a+14:2351:x1872861941839744:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100724.794093:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100724.794100:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac2106 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32ca expref: 14 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100724.794133:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac2106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32ca expref: 14 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100724.794151:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c4fbbb400/0x5564f2c20ac2106 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32ca expref: 14 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100724.794167:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100724.794228:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1995a8cb-3604-41be-a0eb-37e324c5086a+13:2351:x1872861941839744:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 151us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100724.795483:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:2.0:1786100724.795501:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1995a8cb-3604-41be-a0eb-37e324c5086a+13:2352:x1872861941839616:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100724.795515:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100724.795521:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac213e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c332c expref: 13 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.795534:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac213e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c332c expref: 13 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.795549:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7fa99400/0x5564f2c20ac213e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c332c expref: 13 pid: 14324 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.795564:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.795572:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.795586:0:14315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.795602:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.795610:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.795616:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.795622:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100724.795625:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.795633:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100724.795716:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960705280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786100724.795728:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0af484e0-17d7-4fef-8244-23d93563e204:3308:1872861960705408:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786100724.799727:0:16435:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100724.799745:0:16435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.800921:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.800941:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a3c7f51e600/0x5564f2c20ac2168 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100724.801047:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100724.801108:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1995a8cb-3604-41be-a0eb-37e324c5086a+12:2352:x1872861941839616:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 5609us (8417us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100724.801119:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:1.0:1786100724.801218:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:3.0:1786100725.158611:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786100725.158638:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960705536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786100725.158733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100725.158855:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960705536 00000100:00100000:2.0:1786100725.158864:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960705536 00010000:00010000:0.0:1786100725.158897:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100725.158917:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786100725.158927:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960705536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786100725.158981:0:15014:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786100725.159036:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960705536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100725.159044:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1786100725.159586:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960705536:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786100725.159687:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1786100725.989713:0:14326:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786100725.989720:0:14326:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c60c8f000 from 10 10000000:01000000:0.0:1786100725.989724:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786100725.989764:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac216f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100725.989775:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac216f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100725.989786:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac216f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100725.989810:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960705664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786100725.989873:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100725.989914:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47312240 going to sleep for 11 seconds 00000100:00100000:3.0:1786100725.989991:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960705664 00000100:00100000:3.0:1786100725.989998:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960705664 00000100:00100000:3.0:1786100725.990052:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1786100725.990061:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+16:14326:x1872861960705664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100725.990075:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100725.990089:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa98200/0x5564f2c20ac2176 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac216f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100725.990113:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa98200/0x5564f2c20ac2176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac216f expref: 17 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100725.990123:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa98200/0x5564f2c20ac2176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac216f expref: 17 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100725.990131:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98200, rc 0) 00000100:00100000:3.0:1786100725.990175:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+17:14326:x1872861960705664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100725.990181:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1786100725.990349:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960705664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786100725.990364:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac216f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac2176 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100725.990374:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac216f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac2176 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100725.990424:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960705792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100725.990451:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100725.990475:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c583e43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100725.990589:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960705792 00000100:00100000:0.0:1786100725.990593:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960705792 00000100:00100000:0.0:1786100725.990625:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1786100725.990632:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+17:14326:x1872861960705792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100725.990883:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+17:14326:x1872861960705792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100725.990890:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1786100725.991088:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44766680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960705792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100725.991118:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960705920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786100725.991156:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100725.991180:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c48c69cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100725.991388:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960705920 00000100:00100000:2.0:1786100725.991394:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960705920 00000100:00100000:2.0:1786100725.991428:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1786100725.991435:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+17:14326:x1872861960705920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786100725.991580:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+17:14326:x1872861960705920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100725.991588:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1786100725.991624:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960705920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786100725.992853:0:16486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1786100725.993988:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1786100725.994010:0:14326:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786100725.994020:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac216f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac2176 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100725.994032:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3c4fbba200/0x5564f2c20ac216f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac2176 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100725.994879:0:14326:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786100725.994885:0:14326:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3c7cea3000 from 10 10000000:01000000:1.0:1786100725.994890:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786100725.994925:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3b41896c00/0x5564f2c20ac217d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100725.994934:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3b41896c00/0x5564f2c20ac217d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100725.994943:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3b41896c00/0x5564f2c20ac217d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100725.994963:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960706048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786100725.995026:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100725.995062:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c48c69cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786100725.997187:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960706048 00000100:00100000:3.0:1786100725.997198:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960706048 00000100:00100000:3.0:1786100725.997281:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1786100725.997292:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+17:14326:x1872861960706048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786100725.997309:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100725.997326:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c7fa98800/0x5564f2c20ac2184 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac217d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100725.997362:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c7fa98800/0x5564f2c20ac2184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac217d expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100725.997374:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c7fa98800/0x5564f2c20ac2184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac217d expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100725.997383:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98800, rc 0) 00000100:00100000:3.0:1786100725.997454:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0af484e0-17d7-4fef-8244-23d93563e204+18:14326:x1872861960706048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (2428us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100725.997462:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786100725.997494:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960706048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786100725.997513:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3b41896c00/0x5564f2c20ac217d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac2184 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100725.997528:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3b41896c00/0x5564f2c20ac217d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac2184 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100725.997599:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960706176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100725.997630:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100725.997694:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c48c69cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100725.997768:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960706176 00000100:00100000:0.0:1786100725.997772:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960706176 00000100:00100000:0.0:1786100725.997803:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1786100725.997810:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+18:14326:x1872861960706176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100725.998030:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+18:14326:x1872861960706176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100725.998038:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1786100725.998067:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960706176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100725.998094:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960706304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100725.998143:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100725.998159:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47312900 going to sleep for 11 seconds 00000100:00100000:1.0:1786100725.998229:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960706304 00000100:00100000:1.0:1786100725.998233:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960706304 00000100:00100000:1.0:1786100725.998265:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1786100725.998272:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+18:14326:x1872861960706304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786100725.998417:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+18:14326:x1872861960706304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100725.998423:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1786100725.998799:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960706304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786100725.999916:0:16488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1786100726.000084:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1786100726.000103:0:14326:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786100726.000123:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3b41896c00/0x5564f2c20ac217d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac2184 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100726.000136:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3b41896c00/0x5564f2c20ac217d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac2184 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786100726.000165:0:14326:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786100726.000167:0:14326:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a3b42967000 from 10 10000000:01000000:1.0:1786100726.000170:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786100726.000487:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3b41897c00/0x5564f2c20ac218b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100726.000497:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.153@tcp lock: ffff9a3b41897c00/0x5564f2c20ac218b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100726.000508:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.153@tcp lock: ffff9a3b41897c00/0x5564f2c20ac218b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100726.000531:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960706432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786100726.000584:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100726.000625:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c48c69cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100726.000824:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960706432 00000100:00100000:0.0:1786100726.000830:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960706432 00000100:00100000:0.0:1786100726.000904:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1786100726.000914:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+18:14326:x1872861960706432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786100726.000926:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100726.002233:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac2192 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5564f2c20ac218b expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100726.002264:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac2192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5564f2c20ac218b expref: 19 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100726.002274:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbbaa00/0x5564f2c20ac2192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5564f2c20ac218b expref: 19 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100726.002301:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbaa00, rc 0) 00000100:00100000:0.0:1786100726.002369:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+19:14326:x1872861960706432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1456us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100726.002381:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1786100726.002793:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960706432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786100726.002811:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.153@tcp lock: ffff9a3b41897c00/0x5564f2c20ac218b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac2192 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100726.002820:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.153@tcp lock: ffff9a3b41897c00/0x5564f2c20ac218b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5564f2c20ac2192 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100726.002890:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960706560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100726.002920:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100726.002954:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47312240 going to sleep for 11 seconds 00000100:00100000:1.0:1786100726.006151:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960706560 00000100:00100000:1.0:1786100726.006164:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960706560 00000100:00100000:1.0:1786100726.006227:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1786100726.006238:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7fa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:14326:x1872861960706560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786100726.006685:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7fa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:14326:x1872861960706560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 448us (3762us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100726.006694:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1786100726.006874:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960706560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100726.006931:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960706688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100726.006980:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100726.007009:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c47312240 going to sleep for 11 seconds 00000100:00100000:0.0:1786100726.007024:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960706688 00000100:00100000:0.0:1786100726.007027:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960706688 00000100:00100000:0.0:1786100726.007048:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1786100726.007055:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+19:14326:x1872861960706688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100726.007197:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+19:14326:x1872861960706688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100726.007229:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1786100726.007266:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0af484e0-17d7-4fef-8244-23d93563e204:14326:1872861960706688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786100726.008855:0:16489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1786100726.009813:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1786100726.009837:0:14326:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786100726.009847:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.153@tcp lock: ffff9a3b41897c00/0x5564f2c20ac218b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac2192 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100726.009858:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.153@tcp lock: ffff9a3b41897c00/0x5564f2c20ac218b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5564f2c20ac2192 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100726.183063:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786100726.216289:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100726.216352:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941839872 00000100:00100000:0.0:1786100726.216363:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941839872 00000100:00100000:0.0:1786100726.216421:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 114 00000100:00100000:0.0:1786100726.216432:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+11:13759:x1872861941839872:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786100726.216447:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100726.216464:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbba400/0x5564f2c20ac2199 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c335d expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100726.216491:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbba400/0x5564f2c20ac2199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c335d expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100726.216502:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbba400/0x5564f2c20ac2199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c335d expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100726.216513:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbba400, rc 0) 00000100:00100000:0.0:1786100726.216572:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1995a8cb-3604-41be-a0eb-37e324c5086a+12:13759:x1872861941839872:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 142us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100726.216592:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 114 00000100:00100000:3.0:1786100726.224732:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100726.225254:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941840000 00000100:00100000:0.0:1786100726.225264:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941840000 00000100:00100000:0.0:1786100726.225319:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:0.0:1786100726.225329:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+12:13759:x1872861941840000:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786100726.225592:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+12:13759:x1872861941840000:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 263us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100726.225600:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 115 00000100:00100000:3.0:1786100726.231513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100726.231594:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941840128 00000100:00100000:1.0:1786100726.231604:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941840128 00000100:00100000:1.0:1786100726.231687:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:1.0:1786100726.231698:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+12:13759:x1872861941840128:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786100726.231908:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+12:13759:x1872861941840128:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 211us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100726.231923:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 116 00000100:00100000:3.0:1786100726.245507:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100726.246344:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941840256 00000100:00100000:0.0:1786100726.246355:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941840256 00000100:00100000:0.0:1786100726.246404:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00100000:0.0:1786100726.246415:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+12:13759:x1872861941840256:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786100726.246434:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100726.246451:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a3c4fbba600/0x5564f2c20ac21a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3364 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100726.246479:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a3c4fbba600/0x5564f2c20ac21a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3364 expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100726.246490:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a3c4fbba600/0x5564f2c20ac21a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3364 expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100726.246499:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbba600, rc 0) 00000100:00100000:0.0:1786100726.246672:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13759:x1872861941840256:12345-192.168.206.53@tcp:101:ll_cfg_requeue.0 Request processed in 257us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100726.246680:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 117 00000100:00100000:3.0:1786100726.252639:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100726.253561:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941840384 00000100:00100000:2.0:1786100726.253572:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941840384 00000100:00100000:2.0:1786100726.253635:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 118 00000100:00100000:2.0:1786100726.253645:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13759:x1872861941840384:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786100726.253946:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13759:x1872861941840384:12345-192.168.206.53@tcp:501:ll_cfg_requeue.0 Request processed in 300us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100726.253954:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 118 00000100:00100000:3.0:1786100726.256256:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100726.256331:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941840512 00000100:00100000:0.0:1786100726.256340:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941840512 00000100:00100000:0.0:1786100726.256396:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 119 00000100:00100000:0.0:1786100726.256406:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13759:x1872861941840512:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786100726.256621:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+13:13759:x1872861941840512:12345-192.168.206.53@tcp:503:ll_cfg_requeue.0 Request processed in 215us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100726.256641:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 119 00000100:00100000:0.0:1786100727.205456:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0af484e0-17d7-4fef-8244-23d93563e204:3306:1872861960706816:0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.205523:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100727.205574:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960707328:0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.205599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100727.205624:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786100727.205630:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960707200:0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.205670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100727.205693:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960707072:0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.205716:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100727.205733:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786100727.205739:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960706944:0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.205757:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100727.205784:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c451e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960707456:0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.205807:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100727.205833:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960707328 00000100:00100000:0.0:1786100727.205839:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960707328 00000100:00100000:0.0:1786100727.205879:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960707200 00000100:00100000:0.0:1786100727.205882:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960707200 00000100:00100000:0.0:1786100727.205893:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960707456 00000100:00100000:0.0:1786100727.205908:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960707456 00000100:00100000:0.0:1786100727.205928:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786100727.205936:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960707328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.205982:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872861960707328:12345-0@lo:400:kworker.0 Request processed in 46us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100727.205989:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786100727.206004:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786100727.206010:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960707200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.206035:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872861960707200:12345-0@lo:400:kworker.0 Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100727.206041:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786100727.206050:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786100727.206056:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960707456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.206085:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872861960707456:12345-0@lo:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100727.206091:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786100727.206111:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960707072 00000100:00100000:0.0:1786100727.206114:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960707072 00000100:00100000:0.0:1786100727.206136:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960706944 00000100:00100000:0.0:1786100727.206138:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960706944 00000100:00100000:0.0:1786100727.206158:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1786100727.206164:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960707072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.206202:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960707072:12345-0@lo:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100727.206209:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1786100727.206221:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786100727.206227:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960706944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.206263:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960706944:12345-0@lo:400:kworker.0 Request processed in 36us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100727.206269:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1786100727.206291:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786100727.206295:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786100727.206297:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786100727.206327:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960706944:0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.206340:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1872861960707456:0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.206351:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960707072:0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.206388:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872861960707200:0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.206399:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1872861960707328:0@lo:400:kworker.0 00000100:00100000:0.0:1786100727.206523:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960707584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100727.206550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786100727.206594:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100727.206634:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960706816 00000100:00100000:3.0:1786100727.206638:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960706816 00000100:00100000:3.0:1786100727.206693:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1786100727.206700:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:3306:x1872861960706816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786100727.206733:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0af484e0-17d7-4fef-8244-23d93563e204+19:3306:x1872861960706816:12345-0@lo:400:kworker.0 Request processed in 33us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100727.206739:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1786100727.207149:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960707584 00000100:00100000:1.0:1786100727.207154:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960707584 00000100:00100000:1.0:1786100727.207189:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786100727.207208:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960707584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786100727.207235:0:15014:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786100727.207281:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872861960707584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100727.207287:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786100727.207399:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1872861960707584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100727.207466:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c451e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0af484e0-17d7-4fef-8244-23d93563e204:3306:1872861960706816:0@lo:400:kworker.0 00010000:00010000:0.0:1786100728.230063:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100728.404639:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100728.405056:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941840640 00000100:00100000:0.0:1786100728.405069:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941840640 00000100:00100000:0.0:1786100728.405176:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:0.0:1786100728.405200:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+6:14418:x1872861941840640:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786100728.405226:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100728.405252:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac21a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c336b expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.405337:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.405370:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.405384:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.405402:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.405410:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.405416:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.406254:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac21bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.406269:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac21bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.406278:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac21bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100728.406371:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1786100728.406377:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1786100728.406482:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac21bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786100728.407933:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786100728.409040:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409077:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409086:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409093:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100728.409098:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409106:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409127:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a300) 00010000:00010000:0.0:1786100728.409131:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100728.409137:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409144:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409167:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409174:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409181:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409197:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbe00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100728.409207:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409214:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409224:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a3c433dfe00) 00010000:00010000:0.0:1786100728.409227:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100728.409230:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409237:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409300:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac21a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c336b expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409315:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb400/0x5564f2c20ac21bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c336b expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.409323:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:0.0:1786100728.409326:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786100728.409328:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb400, rc 0) 00000100:00100000:0.0:1786100728.409501:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+7:14418:x1872861941840640:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 4311us (4872us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100728.409511:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:3.0:1786100728.425391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100728.425509:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941840896 00000100:00100000:0.0:1786100728.425521:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941840896 00000100:00100000:0.0:1786100728.425595:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:0.0:1786100728.425607:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+7:14418:x1872861941840896:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786100728.425691:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100728.425719:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac21c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3372 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.425839:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21ca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.425855:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.425868:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.425888:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.425896:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.425903:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.426535:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb200/0x5564f2c20ac21d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.426548:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb200/0x5564f2c20ac21d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.426556:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb200/0x5564f2c20ac21d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100728.426569:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1786100728.426921:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.426931:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21ca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.426938:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.426946:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbe00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100728.426950:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.426958:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21ca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.426973:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a3c433dff00) 00010000:00010000:0.0:1786100728.426977:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100728.426982:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.426989:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac21ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.427005:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.427011:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21d1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.427016:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.427032:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100728.427035:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.427041:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21d1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.427050:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a3c433dfe00) 00010000:00010000:0.0:1786100728.427052:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100728.427056:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21d1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.427063:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21d1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.427642:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac21c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3372 expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.427727:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb200/0x5564f2c20ac21d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3372 expref: 9 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.427736:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df000) 00010000:00010000:0.0:1786100728.427739:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100728.427742:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb200, rc 0) 00000100:00100000:0.0:1786100728.427846:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+9:14418:x1872861941840896:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 2240us (2468us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1786100728.427857:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:3.0:1786100728.442645:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100728.442967:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941841024 00000100:00100000:0.0:1786100728.442986:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941841024 00000100:00100000:0.0:1786100728.443069:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:0.0:1786100728.443081:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+9:14418:x1872861941841024:12345-192.168.206.53@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1786100728.443236:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+9:14418:x1872861941841024:12345-192.168.206.53@tcp:59:lhsmtool_posix.0 Request processed in 156us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100728.443245:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:3.0:1786100728.459551:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100728.459608:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100728.459645:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100728.459714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100728.459741:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100728.459768:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100728.459805:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941841408 00000100:00100000:3.0:1786100728.459817:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941841408 00000100:00100000:3.0:1786100728.459878:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941841664 00000100:00100000:3.0:1786100728.459881:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941841664 00000100:00100000:3.0:1786100728.459894:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941841280 00000100:00100000:3.0:1786100728.459897:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941841280 00000100:00100000:3.0:1786100728.459909:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941841792 00000100:00100000:3.0:1786100728.459912:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941841792 00000100:00100000:3.0:1786100728.459927:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:3.0:1786100728.459940:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b75cc12d-1273-459a-9324-4254023794ea+5:2353:x1872861941841408:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100728.460033:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b75cc12d-1273-459a-9324-4254023794ea+5:2353:x1872861941841408:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 94us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100728.460042:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:3.0:1786100728.460062:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:3.0:1786100728.460069:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:2353:x1872861941841664:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100728.460095:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:2353:x1872861941841664:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100728.460101:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:3.0:1786100728.460114:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:3.0:1786100728.460120:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b75cc12d-1273-459a-9324-4254023794ea+5:2353:x1872861941841280:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100728.460142:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b75cc12d-1273-459a-9324-4254023794ea+5:2353:x1872861941841280:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 23us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100728.460168:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:3.0:1786100728.460181:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:3.0:1786100728.460198:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:2353:x1872861941841792:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100728.460224:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:2353:x1872861941841792:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 37us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100728.460231:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00080000:1.0:1786100728.460614:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786100728.460620:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786100728.460700:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941841152 00000100:00100000:0.0:1786100728.460708:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941841152 00000100:00100000:0.0:1786100728.460748:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:0.0:1786100728.460755:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+13:2353:x1872861941841152:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:0.0:1786100728.460804:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1995a8cb-3604-41be-a0eb-37e324c5086a+13:2353:x1872861941841152:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 50us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100728.460810:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 121 00000100:00100000:2.0:1786100728.460962:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941841536 00000100:00100000:2.0:1786100728.460967:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941841536 00000100:00100000:2.0:1786100728.461023:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:2.0:1786100728.461031:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:2353:x1872861941841536:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:2.0:1786100728.461072:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:2353:x1872861941841536:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 42us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100728.461079:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00080000:1.0:1786100728.461161:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786100728.475525:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100728.476391:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941841920 00000100:00100000:1.0:1786100728.476406:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941841920 00000100:00100000:1.0:1786100728.476552:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:1.0:1786100728.476565:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+9:14424:x1872861941841920:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:1.0:1786100728.476593:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100728.476619:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac21e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3379 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.476733:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac21ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.476749:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac21ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.476782:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac21ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.476799:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac21f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.476805:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac21f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.476811:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac21f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477116:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac21ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477126:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac21ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477133:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac21ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477140:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100728.477144:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac21ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477153:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac21ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477167:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a300) 00010000:00010000:1.0:1786100728.477170:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100728.477176:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac21ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477206:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac21ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477222:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac21f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477228:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac21f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477234:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac21f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477239:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100728.477243:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac21f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477250:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac21f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477258:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a3c4627a200) 00010000:00010000:1.0:1786100728.477261:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100728.477263:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac21f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477268:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac21f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477307:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac21e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3379 expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477331:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a300) 00010000:00010000:1.0:1786100728.477334:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100728.477338:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac21e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3379 expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.477348:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3b41897400, rc 0) 00000100:00100000:1.0:1786100728.477444:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+9:14424:x1872861941841920:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 880us (1931us total) trans 0 rc 301/301 00000100:00100000:1.0:1786100728.477453:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:2.0:1786100728.487584:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100728.487707:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941842048 00000100:00100000:3.0:1786100728.487720:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941842048 00000100:00100000:3.0:1786100728.487788:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:3.0:1786100728.487800:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b75cc12d-1273-459a-9324-4254023794ea+9:14424:x1872861941842048:12345-192.168.206.53@tcp:700:lfs.0 00000100:00100000:3.0:1786100728.487961:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b75cc12d-1273-459a-9324-4254023794ea+9:14424:x1872861941842048:12345-192.168.206.53@tcp:700:lfs.0 Request processed in 163us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100728.487970:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:3.0:1786100728.499068:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100728.499237:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941842304 00000100:00100000:0.0:1786100728.499249:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941842304 00000100:00100000:0.0:1786100728.499317:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:0.0:1786100728.499328:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+9:14424:x1872861941842304:12345-192.168.206.53@tcp:36:lfs.0 00010000:00010000:0.0:1786100728.499400:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100728.499434:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac2129 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c32f4 expref: 9 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.499458:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a300) 00010000:00010000:0.0:1786100728.499464:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786100728.499873:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.499892:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2161 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3356 expref: 5 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.499911:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.499954:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2161 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3356 expref: 5 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.499970:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2161 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3356 expref: 5 pid: 14328 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100728.499987:0:14329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14329:1872861960707712:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100728.500111:0:14329:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c472896c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100728.505512:0:14329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14329:1872861960707712:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100728.505554:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100728.514354:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100728.520070:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941842432 00000100:00100000:2.0:1786100728.520104:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941842432 00010000:00010000:2.0:1786100728.520182:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2161 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3356 expref: 6 pid: 14328 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100728.520258:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:2.0:1786100728.520270:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:2352:x1872861941842432:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100728.520292:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100728.520319:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2161 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3356 expref: 6 pid: 14328 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.520335:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2161 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3356 expref: 6 pid: 14328 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.520363:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2161 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3356 expref: 6 pid: 14328 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.520386:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a300) 00010000:00010000:2.0:1786100728.520392:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.520402:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.520410:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.520440:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100728.520524:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:2352:x1872861941842432:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 256us (6184us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100728.520533:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00010000:00010000:0.0:1786100728.521228:0:14329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.521241:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.521271:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac2202 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.521282:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac2202 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.521292:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac2202 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100728.525358:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1786100728.525386:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.525420:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.525428:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.525435:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100728.525442:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.525451:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.525473:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a300) 00010000:00010000:0.0:1786100728.525476:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100728.525482:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.525488:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac21fb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786100728.525516:0:14329:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000872052cf reply state 000000003b1a8551 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac2202 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100728.525526:0:14329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786100728.525974:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+10:14424:x1872861941842304:12345-192.168.206.53@tcp:36:lfs.0 Request processed in 26641us (26912us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1786100728.525985:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00010000:00010000:0.0:1786100728.530964:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac2202 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.531009:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac2202 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.531018:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac2202 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.531025:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbbe00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100728.531030:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac2202 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.531039:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac2202 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.531059:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a3c433dfe00) 00010000:00010000:0.0:1786100728.531063:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100728.531069:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac2202 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.531075:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac2202 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100728.631915:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100728.632259:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941842560 00000100:00100000:1.0:1786100728.632572:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941842560 00000100:00100000:1.0:1786100728.632730:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:1.0:1786100728.632753:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+9:14432:x1872861941842560:12345-192.168.206.53@tcp:101:lctl.0 00010000:00010000:1.0:1786100728.632787:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100728.632817:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac2209 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3380 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.632901:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac2210 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.632917:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac2210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.632930:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac2210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100728.633006:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786100728.633026:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100728.633076:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac2210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.633106:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac2209 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3380 expref: 11 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.633127:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896200/0x5564f2c20ac2210 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3380 expref: 10 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.633137:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a200) 00010000:00010000:1.0:1786100728.633140:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786100728.633145:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3b41896200, rc 0) 00000100:00100000:1.0:1786100728.633971:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+10:14432:x1872861941842560:12345-192.168.206.53@tcp:101:lctl.0 Request processed in 1222us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100728.633982:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:3.0:1786100728.666925:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100728.667520:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941842688 00000100:00100000:0.0:1786100728.667533:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941842688 00000100:00100000:0.0:1786100728.667712:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:0.0:1786100728.667723:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:14433:x1872861941842688:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1786100728.667750:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100728.667773:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac2217 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3387 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.667880:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac221e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.667897:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac221e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.667910:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac221e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100728.667988:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786100728.667993:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1786100728.668022:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac221e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.668053:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac2217 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3387 expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.668073:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbbe00/0x5564f2c20ac221e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3387 expref: 6 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.668082:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a200) 00010000:00010000:0.0:1786100728.668086:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786100728.668090:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbbe00, rc 0) 00000100:00100000:0.0:1786100728.668174:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:14433:x1872861941842688:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 452us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100728.668182:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 21 00000100:00100000:0.0:1786100728.677632:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000040:00080000:1.0:1786100728.678248:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1786100728.678930:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941842816 00000100:00100000:2.0:1786100728.678942:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941842816 00000100:00100000:2.0:1786100728.679063:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:2.0:1786100728.679074:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:14433:x1872861941842816:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100728.679101:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100728.679128:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac2225 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c338e expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679242:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac222c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679259:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac222c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679288:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac222c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679307:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2233 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679314:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2233 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679579:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2233 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679750:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac223a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679760:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac223a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679767:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac223a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100728.679815:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1786100728.679819:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100728.679848:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac223a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679879:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac222c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679886:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac222c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679895:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac222c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679903:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51fc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100728.679909:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac222c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679918:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac222c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679933:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a200) 00010000:00010000:2.0:1786100728.679937:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100728.679943:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac222c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679951:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac222c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679967:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2233 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679974:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2233 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679980:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2233 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.679993:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100728.679996:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2233 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.680003:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2233 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.680013:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a3c58043e00) 00010000:00010000:2.0:1786100728.680017:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100728.680020:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2233 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.680027:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2233 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.680075:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac2225 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c338e expref: 8 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.680092:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac223a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c338e expref: 7 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.680101:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a3c58043500) 00010000:00010000:2.0:1786100728.680103:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786100728.680106:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51ea00, rc 0) 00000100:00100000:2.0:1786100728.680571:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+7:14433:x1872861941842816:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1496us (4746us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100728.680582:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 22 00000100:00100000:3.0:1786100728.685892:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100728.688141:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941843072 00000100:00100000:0.0:1786100728.688256:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941843072 00000100:00100000:0.0:1786100728.691720:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:0.0:1786100728.691739:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+7:14433:x1872861941843072:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1786100728.691768:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100728.691796:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac2241 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3395 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100728.691964:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1786100728.692117:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac2241 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3395 expref: 9 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.692134:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a200) 00010000:00010000:0.0:1786100728.692137:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786100728.692143:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac2241 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3395 expref: 9 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.692160:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb800, rc 0) 00000100:00100000:0.0:1786100728.693040:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+8:14433:x1872861941843072:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1299us (7225us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1786100728.693049:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 23 00000100:00100000:3.0:1786100728.701936:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100728.702033:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941843328 00000100:00100000:2.0:1786100728.702062:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941843328 00000100:00100000:2.0:1786100728.702146:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:2.0:1786100728.702157:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+8:14433:x1872861941843328:12345-192.168.206.53@tcp:36:lfs.0 00010000:00010000:2.0:1786100728.702237:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100728.702269:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac223a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c338e expref: 8 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.702290:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a3c58043500) 00010000:00010000:2.0:1786100728.702306:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100728.702336:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac224f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.702349:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac224f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.702359:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac224f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100728.702637:0:14328:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006fce97d reply state 00000000647dc58c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac224f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100728.702686:0:14328:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1786100728.702702:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1786100728.702807:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+9:14433:x1872861941843328:12345-192.168.206.53@tcp:36:lfs.0 Request processed in 651us (886us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1786100728.702815:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 24 00000100:00100000:3.0:1786100728.705317:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00010000:00010000:2.0:1786100728.705438:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac224f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.705453:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac224f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.705479:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac224f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.705486:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51ee00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100728.705491:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac224f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.705500:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac224f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.705518:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a3c58043e00) 00010000:00010000:2.0:1786100728.705521:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1786100728.705526:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac224f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.705533:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ee00/0x5564f2c20ac224f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100728.708106:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941843584 00000100:00100000:0.0:1786100728.708123:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941843584 00000100:00100000:1.0:1786100728.708337:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:1.0:1786100728.708351:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+8:14433:x1872861941843584:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1786100728.708756:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+9:14433:x1872861941843584:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 406us (3451us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1786100728.708765:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:3.0:1786100728.716298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100728.716736:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941843840 00000100:00100000:0.0:1786100728.716749:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941843840 00000100:00100000:0.0:1786100728.716830:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:0.0:1786100728.716844:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+9:14433:x1872861941843840:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1786100728.716877:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100728.716902:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac2256 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c339c expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717024:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac225d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717040:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac225d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717053:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac225d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717073:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2264 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717080:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717086:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100728.717272:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1786100728.717397:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac225d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717407:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac225d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717414:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac225d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717422:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbba00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100728.717428:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac225d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717448:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac225d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717463:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a200) 00010000:00010000:0.0:1786100728.717466:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100728.717472:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac225d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717479:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac225d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717495:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717501:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2264 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717506:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2264 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717512:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100728.717514:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2264 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717520:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2264 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717527:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a3c433dfe00) 00010000:00010000:0.0:1786100728.717530:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100728.717533:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2264 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717549:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2264 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717597:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac2256 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c339c expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717622:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a200) 00010000:00010000:0.0:1786100728.717625:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786100728.717629:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac2256 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c339c expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.717640:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb800, rc 0) 00000100:00100000:0.0:1786100728.717772:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+10:14433:x1872861941843840:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 931us (1486us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1786100728.717781:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 25 00000100:00100000:3.0:1786100728.724709:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100728.727816:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941843968 00000100:00100000:0.0:1786100728.727837:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941843968 00000100:00100000:0.0:1786100728.727994:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:0.0:1786100728.728009:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+10:14433:x1872861941843968:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:0.0:1786100728.728042:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100728.728076:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac2272 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33a3 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.728200:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2279 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.728217:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2279 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.728247:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2279 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100728.728570:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1786100728.728575:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786100728.728604:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2279 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.728638:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac2272 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33a3 expref: 12 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.728751:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2279 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33a3 expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.728762:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:0.0:1786100728.728765:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786100728.728770:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb000, rc 0) 00000100:00100000:0.0:1786100728.729263:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+11:14433:x1872861941843968:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1255us (4609us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100728.729272:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 26 00000100:00100000:3.0:1786100728.735226:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100728.735459:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941844096 00000100:00100000:2.0:1786100728.735473:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941844096 00000100:00100000:2.0:1786100728.735537:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:2.0:1786100728.735549:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+11:14433:x1872861941844096:12345-192.168.206.53@tcp:37:lfs.0 00000100:00100000:1.0:1786100728.740174:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+11:14433:x1872861941844096:12345-192.168.206.53@tcp:37:lfs.0 Request processed in 4609us (4945us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100728.740202:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:0.0:1786100728.752252:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100728.752474:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941844352 00000100:00100000:1.0:1786100728.752487:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941844352 00000100:00100000:1.0:1786100728.752629:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:1.0:1786100728.752642:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45814450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+11:14433:x1872861941844352:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:1.0:1786100728.754832:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45814450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+12:14433:x1872861941844352:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 2179us (2581us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1786100728.754846:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:3.0:1786100728.828233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100728.829382:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941844480 00000100:00100000:0.0:1786100728.829398:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941844480 00000100:00100000:1.0:1786100728.829610:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:1.0:1786100728.829623:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+10:14439:x1872861941844480:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:1.0:1786100728.829667:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100728.829696:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac2280 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33aa expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.829777:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac2287 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.829794:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac2287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.829810:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac2287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.829828:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac228e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.829836:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac228e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.829842:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac228e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.829997:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896a00/0x5564f2c20ac2295 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834520:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896a00/0x5564f2c20ac2295 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834540:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896a00/0x5564f2c20ac2295 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100728.834641:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1786100728.834646:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100728.834740:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896a00/0x5564f2c20ac2295 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834759:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac2287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834766:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac2287 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834773:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac2287 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834780:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897200 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100728.834785:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac2287 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834794:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac2287 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834808:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a200) 00010000:00010000:1.0:1786100728.834812:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100728.834817:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac2287 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834849:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac2287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834869:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac228e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834876:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac228e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834882:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac228e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834887:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100728.834890:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac228e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834897:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac228e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834906:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a3c4627a500) 00010000:00010000:1.0:1786100728.834909:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100728.834912:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac228e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834917:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac228e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834971:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac2280 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33aa expref: 12 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.834987:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896a00/0x5564f2c20ac2295 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33aa expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.835001:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:1.0:1786100728.835004:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786100728.835007:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3b41896a00, rc 0) 00000100:00100000:1.0:1786100728.835111:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+11:14439:x1872861941844480:12345-192.168.206.53@tcp:101:bash.0 Request processed in 5487us (6889us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100728.835123:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 27 00000100:00100000:1.0:1786100728.846273:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100728.846380:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941844736 00000100:00100000:0.0:1786100728.846392:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941844736 00000100:00100000:0.0:1786100728.846470:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:0.0:1786100728.846482:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+11:14439:x1872861941844736:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:0.0:1786100728.846508:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100728.846555:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac229c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33b1 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.846755:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.846771:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2279 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33a3 expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.846780:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.846821:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2279 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33a3 expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.846834:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2279 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33a3 expref: 11 pid: 14330 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100728.846849:0:14330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c50d8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14330:1872861960707840:192.168.206.53@tcp:104: 00000100:00100000:0.0:1786100728.847080:0:14330:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c472896c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786100728.851300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100728.851443:0:14330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c50d8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14330:1872861960707840:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100728.851480:0:14330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100728.856041:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941844864 00000100:00100000:1.0:1786100728.856063:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941844864 00010000:00010000:0.0:1786100728.856309:0:16437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2279 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33a3 expref: 12 pid: 14330 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100728.856416:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:0.0:1786100728.856429:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+12:2352:x1872861941844864:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100728.856450:0:16437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100728.856458:0:16437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2279 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33a3 expref: 12 pid: 14330 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.856491:0:16437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2279 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33a3 expref: 12 pid: 14330 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.856518:0:16437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2279 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33a3 expref: 12 pid: 14330 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.856538:0:16437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:0.0:1786100728.856544:0:16437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.856555:0:16437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.856564:0:16437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.856606:0:16437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100728.856752:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+11:2352:x1872861941844864:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 324us (5465us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100728.856760:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00010000:00010000:3.0:1786100728.856831:0:14330:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.856840:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.856871:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22aa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.856882:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.856891:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.857838:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98000/0x5564f2c20ac22b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.857851:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98000/0x5564f2c20ac22b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.857861:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98000/0x5564f2c20ac22b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100728.857875:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1786100728.857909:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.857917:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.857924:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.857944:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100728.857949:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.857959:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.857971:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:3.0:1786100728.857975:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100728.857979:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.857986:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb800/0x5564f2c20ac22a3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786100728.858001:0:14330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7fdb32a reply state 00000000a4bbfb55 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100728.858010:0:14330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786100728.858050:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac229c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b1 expref: 14 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.858066:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98000/0x5564f2c20ac22b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b1 expref: 13 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.858074:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:3.0:1786100728.858076:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1786100728.858079:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa98000, rc 0) 00000100:00100000:3.0:1786100728.858139:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+14:14439:x1872861941844736:12345-192.168.206.53@tcp:101:bash.0 Request processed in 11658us (11878us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1786100728.858154:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 28 00010000:00010000:0.0:1786100728.864097:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.864131:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22aa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.864141:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.864177:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100728.864198:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.864208:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22aa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.864231:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a3c454abb00) 00010000:00010000:0.0:1786100728.864235:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100728.864241:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22aa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100728.864249:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22aa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100728.876689:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100728.876909:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941844992 00000100:00100000:1.0:1786100728.876921:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941844992 00000100:00100000:1.0:1786100728.876995:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:1.0:1786100728.877006:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c50d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+13:14439:x1872861941844992:12345-192.168.206.53@tcp:101:bash.0 00010000:00010000:1.0:1786100728.877038:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100728.877065:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac22bf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33b8 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.877147:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac22c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.877163:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac22c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100728.877174:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac22c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100728.877612:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1786100728.877618:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100728.878277:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac22c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.878375:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac22c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.878420:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac22bf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b8 expref: 15 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.878446:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac22c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b8 expref: 14 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100728.878455:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:2.0:1786100728.878458:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100728.878462:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3b41897200, rc 0) 00000100:00100000:2.0:1786100728.878593:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c50d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+14:14439:x1872861941844992:12345-192.168.206.53@tcp:101:bash.0 Request processed in 1588us (1956us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100728.878602:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:3.0:1786100728.882068:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100728.882216:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941845248 00000100:00100000:2.0:1786100728.882229:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941845248 00000100:00100000:2.0:1786100728.882305:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:2.0:1786100728.882327:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b75cc12d-1273-459a-9324-4254023794ea+14:14439:x1872861941845248:12345-192.168.206.53@tcp:35:bash.0 00000100:00100000:2.0:1786100728.882833:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b75cc12d-1273-459a-9324-4254023794ea+15:14439:x1872861941845248:12345-192.168.206.53@tcp:35:bash.0 Request processed in 507us (778us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1786100728.882842:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:2.0:1786100728.992793:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100728.993399:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941845504 00000100:00100000:3.0:1786100728.993412:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941845504 00000100:00100000:3.0:1786100728.993636:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 30 00000100:00100000:3.0:1786100728.994080:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+15:14449:x1872861941845504:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:3.0:1786100728.994116:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100728.994144:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33bf expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786100728.994601:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1786100728.994803:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33bf expref: 17 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.995481:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3c4627a200) 00010000:00010000:3.0:1786100728.995487:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786100728.995497:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33bf expref: 17 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100728.995518:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99600, rc 0) 00000100:00100000:3.0:1786100728.995764:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+16:14449:x1872861941845504:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 2116us (2984us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1786100728.995774:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 30 00000100:00100000:3.0:1786100729.000148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.000481:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941845760 00000100:00100000:2.0:1786100729.000494:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941845760 00000100:00100000:2.0:1786100729.000571:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:2.0:1786100729.000584:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3b42515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b75cc12d-1273-459a-9324-4254023794ea+16:14449:x1872861941845760:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:2.0:1786100729.001590:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3b42515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b75cc12d-1273-459a-9324-4254023794ea+17:14449:x1872861941845760:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 1002us (1448us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1786100729.001602:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:1.0:1786100729.048495:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.048603:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941846016 00000100:00100000:2.0:1786100729.048617:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941846016 00000100:00100000:2.0:1786100729.048756:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:2.0:1786100729.048769:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+17:14452:x1872861941846016:12345-192.168.206.53@tcp:101:lfs.0 00010000:00010000:2.0:1786100729.048800:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100729.049026:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac22db lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33c6 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.049156:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac22e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.049173:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac22e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.049200:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac22e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100729.049212:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1786100729.049370:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51ea00/0x5564f2c20ac22db lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33c6 expref: 20 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.049393:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac22e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33c6 expref: 19 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.049402:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:2.0:1786100729.049540:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786100729.049544:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51e200, rc 0) 00000100:00100000:2.0:1786100729.050003:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+19:14452:x1872861941846016:12345-192.168.206.53@tcp:101:lfs.0 Request processed in 1233us (1587us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1786100729.050013:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 31 00000100:00100000:1.0:1786100729.055154:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100729.055332:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941846144 00000100:00100000:3.0:1786100729.055346:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941846144 00000100:00100000:3.0:1786100729.055446:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:3.0:1786100729.055458:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+19:14452:x1872861941846144:12345-192.168.206.53@tcp:54:lfs.0 00010000:00010000:3.0:1786100729.055552:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.055574:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.055588:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.055622:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.056088:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.056098:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.056106:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100729.056111:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.056120:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.056134:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:3.0:1786100729.056138:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786100729.056143:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22f0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.056166:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac22f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100729.056273:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+19:14452:x1872861941846144:12345-192.168.206.53@tcp:54:lfs.0 Request processed in 815us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100729.056283:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 32 00000100:00100000:3.0:1786100729.059807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.059932:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941846272 00000100:00100000:2.0:1786100729.059945:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941846272 00000100:00100000:2.0:1786100729.060029:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:2.0:1786100729.060041:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b75cc12d-1273-459a-9324-4254023794ea+19:2351:x1872861941846272:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100729.060060:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100729.060090:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac22e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33c6 expref: 19 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.060111:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:2.0:1786100729.060116:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100729.060195:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b75cc12d-1273-459a-9324-4254023794ea+18:2351:x1872861941846272:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 155us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100729.060203:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:1.0:1786100729.062561:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100729.063010:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941846528 00000100:00100000:3.0:1786100729.063022:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941846528 00000100:00100000:3.0:1786100729.063087:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:3.0:1786100729.063098:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b75cc12d-1273-459a-9324-4254023794ea+18:14452:x1872861941846528:12345-192.168.206.53@tcp:35:lfs.0 00000100:00100000:3.0:1786100729.063427:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b75cc12d-1273-459a-9324-4254023794ea+19:14452:x1872861941846528:12345-192.168.206.53@tcp:35:lfs.0 Request processed in 330us (879us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1786100729.063443:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:2.0:1786100729.245191:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100729.245362:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941846784 00000100:00100000:0.0:1786100729.245376:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941846784 00000100:00100000:0.0:1786100729.245450:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:0.0:1786100729.245463:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+19:14483:x1872861941846784:12345-192.168.206.53@tcp:101:cat.0 00010000:00010000:0.0:1786100729.245496:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100729.245525:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac22f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33cd expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.245687:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac22fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.245705:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac22fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.245751:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac22fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100729.245766:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1786100729.245943:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac22f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33cd expref: 22 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.245966:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac22fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33cd expref: 21 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.245976:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:0.0:1786100729.245979:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786100729.245983:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbba00, rc 0) 00000100:00100000:0.0:1786100729.246067:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+21:14483:x1872861941846784:12345-192.168.206.53@tcp:101:cat.0 Request processed in 606us (899us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1786100729.246074:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 33 00000100:00100000:0.0:1786100729.248921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100729.249033:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941847040 00000100:00100000:3.0:1786100729.249045:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941847040 00000100:00100000:3.0:1786100729.249111:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:3.0:1786100729.249123:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b75cc12d-1273-459a-9324-4254023794ea+21:14483:x1872861941847040:12345-192.168.206.53@tcp:35:cat.0 00000100:00100000:3.0:1786100729.249551:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b75cc12d-1273-459a-9324-4254023794ea+22:14483:x1872861941847040:12345-192.168.206.53@tcp:35:cat.0 Request processed in 429us (640us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1786100729.249561:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 8 00000100:00100000:3.0:1786100729.250251:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100729.250323:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941847168 00000100:00100000:0.0:1786100729.250332:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941847168 00000100:00100000:0.0:1786100729.250388:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:0.0:1786100729.250398:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b75cc12d-1273-459a-9324-4254023794ea+22:2351:x1872861941847168:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786100729.250414:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100729.250444:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac22fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33cd expref: 22 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.250472:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:0.0:1786100729.250489:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786100729.250535:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b75cc12d-1273-459a-9324-4254023794ea+21:2351:x1872861941847168:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 138us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100729.250543:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00010000:00010000:3.0:1786100729.253687:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100729.320755:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100729.320948:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941847424 00000100:00100000:3.0:1786100729.320960:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941847424 00000100:00100000:3.0:1786100729.321037:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:3.0:1786100729.321069:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+21:14489:x1872861941847424:12345-192.168.206.53@tcp:101:dd.0 00010000:00010000:3.0:1786100729.321103:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100729.321130:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac230c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33d4 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.321268:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac2313 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.321285:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98000/0x5564f2c20ac22b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b1 expref: 22 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.321294:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac22c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b8 expref: 22 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.321304:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac2313 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.321349:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac22c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b8 expref: 22 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.321364:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac22c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b8 expref: 22 pid: 14329 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100729.321380:0:14330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14330:1872861960707968:192.168.206.53@tcp:104: 00010000:00010000:3.0:1786100729.321516:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98000/0x5564f2c20ac22b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b1 expref: 22 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.321527:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98000/0x5564f2c20ac22b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b1 expref: 22 pid: 14330 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100729.321545:0:14330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14330:1872861960708096:192.168.206.53@tcp:104: 00000100:00100000:3.0:1786100729.321571:0:14330:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7490be40 going to sleep for 11 seconds 00000100:00100000:3.0:1786100729.325436:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100729.325638:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.325918:0:14330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14330:1872861960707968:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100729.325935:0:14330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14330:1872861960708096:192.168.206.53@tcp:104: 00010000:00010000:2.0:1786100729.325968:0:14330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac2313 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100729.326028:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941847552 00000100:00100000:1.0:1786100729.326037:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941847552 00010000:00010000:1.0:1786100729.326086:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac22c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b8 expref: 23 pid: 14329 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100729.326200:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941847680 00000100:00100000:0.0:1786100729.326205:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941847680 00010000:00010000:0.0:1786100729.326227:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98000/0x5564f2c20ac22b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b1 expref: 24 pid: 14330 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100729.326264:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:0.0:1786100729.326286:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c4811cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b75cc12d-1273-459a-9324-4254023794ea+24:2352:x1872861941847552:12345-192.168.206.53@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1786100729.327729:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:2.0:1786100729.327755:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b75cc12d-1273-459a-9324-4254023794ea+24:2352:x1872861941847680:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100729.327800:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100729.327812:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98000/0x5564f2c20ac22b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b1 expref: 24 pid: 14330 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.327829:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98000/0x5564f2c20ac22b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b1 expref: 24 pid: 14330 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.327858:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa98000/0x5564f2c20ac22b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b1 expref: 24 pid: 14330 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.327879:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:2.0:1786100729.327885:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac2313 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.327895:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac2313 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.327903:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100729.327978:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b75cc12d-1273-459a-9324-4254023794ea+23:2352:x1872861941847680:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 236us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100729.327987:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00010000:00010000:0.0:1786100729.328125:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786100729.328137:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac22c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b8 expref: 22 pid: 14329 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.328152:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac22c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b8 expref: 22 pid: 14329 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.328190:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897200/0x5564f2c20ac22c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33b8 expref: 22 pid: 14329 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.328203:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:0.0:1786100729.328208:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac2313 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.328218:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac2313 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.328227:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac2313 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.328286:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100729.330482:0:14330:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac2313 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.330501:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac2313 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100729.330522:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c4811cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b75cc12d-1273-459a-9324-4254023794ea+21:2352:x1872861941847552:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 4241us (5257us total) trans 0 rc 0/0 00000004:00200000:2.0:1786100729.330528:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:0.0:1786100729.330538:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00010000:00010000:2.0:1786100729.330956:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac230c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33d4 expref: 22 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.330999:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99200/0x5564f2c20ac2313 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33d4 expref: 21 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.331009:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:2.0:1786100729.331012:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786100729.331016:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99200, rc 0) 00000100:00100000:2.0:1786100729.331072:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+21:14489:x1872861941847424:12345-192.168.206.53@tcp:101:dd.0 Request processed in 10006us (10341us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1786100729.331079:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 34 00000100:00100000:3.0:1786100729.336007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100729.336087:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941847936 00000100:00100000:1.0:1786100729.336100:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941847936 00000100:00100000:1.0:1786100729.336239:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 35 00000100:00100000:1.0:1786100729.336251:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+21:14489:x1872861941847936:12345-192.168.206.53@tcp:36:dd.0 00010000:00010000:1.0:1786100729.336637:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897600/0x5564f2c20ac2321 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.337003:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897600/0x5564f2c20ac2321 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.337017:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897600/0x5564f2c20ac2321 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786100729.337081:0:14328:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1786100729.337130:0:14328:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000756c95f4 reply state 00000000897d89c2 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897600/0x5564f2c20ac2321 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100729.337141:0:14328:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786100729.337284:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+24:14489:x1872861941847936:12345-192.168.206.53@tcp:36:dd.0 Request processed in 1032us (1288us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1786100729.337293:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 35 00000020:00080000:1.0:1786100729.338436:0:14328:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786100729.341641:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897600/0x5564f2c20ac2321 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.341893:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897600/0x5564f2c20ac2321 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.341903:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897600/0x5564f2c20ac2321 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.341911:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100729.341917:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897600/0x5564f2c20ac2321 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.341926:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897600/0x5564f2c20ac2321 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.341947:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:0.0:1786100729.341951:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100729.341955:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897600/0x5564f2c20ac2321 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.341962:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897600/0x5564f2c20ac2321 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100729.344440:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.344561:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941848064 00000100:00100000:2.0:1786100729.344574:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941848064 00000100:00100000:2.0:1786100729.344861:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:2.0:1786100729.344874:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+23:14489:x1872861941848064:12345-192.168.206.53@tcp:101:dd.0 00010000:00010000:2.0:1786100729.344907:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100729.344933:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2328 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33db expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.345025:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2328 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33db expref: 24 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.345043:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2328 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33db expref: 24 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.345068:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:2.0:1786100729.345071:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786100729.345097:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51e200, rc 0) 00000100:00100000:2.0:1786100729.345178:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+24:14489:x1872861941848064:12345-192.168.206.53@tcp:101:dd.0 Request processed in 306us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100729.345198:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 36 00000100:00100000:3.0:1786100729.362157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.363110:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941848320 00000100:00100000:2.0:1786100729.363124:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941848320 00000100:00100000:2.0:1786100729.363212:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:2.0:1786100729.363223:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b75cc12d-1273-459a-9324-4254023794ea+24:14489:x1872861941848320:12345-192.168.206.53@tcp:103:dd.0 00010000:00010000:2.0:1786100729.363244:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100729.363274:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2328 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33db expref: 24 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.363297:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:2.0:1786100729.363303:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100729.363373:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b75cc12d-1273-459a-9324-4254023794ea+23:14489:x1872861941848320:12345-192.168.206.53@tcp:103:dd.0 Request processed in 151us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100729.363381:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:3.0:1786100729.367900:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100729.368270:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941848448 00000100:00100000:1.0:1786100729.368283:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941848448 00000100:00100000:1.0:1786100729.368358:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:1.0:1786100729.368371:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+23:14489:x1872861941848448:12345-192.168.206.53@tcp:58:dd.0 00010000:00010000:1.0:1786100729.368529:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac232f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.368550:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac232f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.368564:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac232f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786100729.373458:0:14328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786100729.373638:0:14328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1786100729.373762:0:14328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1786100729.373928:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+23:14489:x1872861941848448:12345-192.168.206.53@tcp:58:dd.0 Request processed in 5552us (6034us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100729.373940:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 37 00000100:00100000:3.0:1786100729.376456:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.376569:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941848576 00000100:00100000:2.0:1786100729.376581:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941848576 00000100:00100000:2.0:1786100729.376687:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 38 00000100:00100000:2.0:1786100729.376698:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+23:14489:x1872861941848576:12345-192.168.206.53@tcp:101:dd.0 00010000:00010000:2.0:1786100729.376723:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100729.376766:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2336 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33e2 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.376868:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac232f lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.376893:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2336 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33e2 expref: 24 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.376915:0:14330:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac232f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.376930:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2336 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33e2 expref: 24 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.376947:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:2.0:1786100729.376950:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786100729.376954:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2336 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33e2 expref: 24 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.377214:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51e200, rc 0) 00000100:00100000:2.0:1786100729.377287:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+24:14489:x1872861941848576:12345-192.168.206.53@tcp:101:dd.0 Request processed in 590us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100729.377295:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 38 00000040:00080000:1.0:1786100729.701981:0:14362:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1786100729.701992:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786100729.702036:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1786100729.702044:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1786100729.702214:0:14362:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14362:1872861960708224:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786100729.702343:0:14362:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c48c5d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786100729.707284:0:14362:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c6db27b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14362:1872861960708224:192.168.206.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786100729.709368:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100729.711206:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941848704 00000100:00100000:0.0:1786100729.711226:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941848704 00000100:00100000:0.0:1786100729.711326:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:0.0:1786100729.711339:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c6db27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b75cc12d-1273-459a-9324-4254023794ea+24:14490:x1872861941848704:12345-192.168.206.53@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1786100729.711450:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c6db27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b75cc12d-1273-459a-9324-4254023794ea+24:14490:x1872861941848704:12345-192.168.206.53@tcp:900:lhsmtool_posix.0 Request processed in 113us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100729.711458:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:3.0:1786100729.718790:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100729.718967:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941848832 00000100:00100000:1.0:1786100729.718999:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941848832 00000100:00100000:1.0:1786100729.719082:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:1.0:1786100729.719095:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+24:14490:x1872861941848832:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786100729.719138:0:14328:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786100729.719434:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+24:14490:x1872861941848832:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 340us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100729.719443:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 39 00000100:00100000:3.0:1786100729.725698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.726875:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941848960 00000100:00100000:2.0:1786100729.726893:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941848960 00000100:00100000:1.0:1786100729.726997:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:1.0:1786100729.727014:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+24:14490:x1872861941848960:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1786100729.727126:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac233d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727146:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac233d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727160:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac233d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727248:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac2344 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727258:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac2344 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727266:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac2344 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727297:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac234b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727328:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac234b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727336:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac234b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786100729.727419:0:14328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1786100729.727458:0:14328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786100729.727480:0:14328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac234b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727493:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac233d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727499:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac233d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727506:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac233d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727513:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896800 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100729.727517:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac233d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727525:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac233d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727539:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df000) 00010000:00010000:1.0:1786100729.727543:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100729.727549:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac233d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727566:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac233d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727583:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac2344 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727588:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac2344 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727594:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac2344 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727599:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100729.727603:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac2344 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727609:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac2344 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727617:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9a3c4627a500) 00010000:00010000:1.0:1786100729.727620:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100729.727623:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac2344 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727629:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac2344 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727645:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac234b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727840:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac234b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727915:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac234b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727920:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:1.0:1786100729.727923:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac234b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727930:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac234b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727939:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:1.0:1786100729.727941:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786100729.727944:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac234b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.727950:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896000/0x5564f2c20ac234b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100729.728100:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+24:14490:x1872861941848960:12345-192.168.206.53@tcp:34:lhsmtool_posix.0 Request processed in 1088us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100729.728110:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 40 00000100:00100000:2.0:1786100729.732094:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100729.732144:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941849216 00000100:00100000:0.0:1786100729.732158:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941849216 00000100:00100000:0.0:1786100729.732243:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:0.0:1786100729.732255:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+24:14490:x1872861941849216:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786100729.732281:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100729.732308:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2352 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33e9 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.732444:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2359 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.732462:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2359 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.732475:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2359 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786100729.732488:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1786100729.732619:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2359 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.732639:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2359 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.732647:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2359 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.734401:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100729.734409:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2359 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.734420:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2359 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.734442:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:0.0:1786100729.734445:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786100729.734451:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2359 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.734458:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac2359 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.734537:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2352 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33e9 expref: 26 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.734550:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a3c433df000) 00010000:00010000:0.0:1786100729.734552:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786100729.734556:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2352 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33e9 expref: 26 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.734567:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbba00, rc 0) 00000100:00100000:0.0:1786100729.734697:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+25:14490:x1872861941849216:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 2442us (2624us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1786100729.734708:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 41 00000100:00100000:0.0:1786100729.743109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100729.743241:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941849344 00000100:00100000:1.0:1786100729.743253:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941849344 00000100:00100000:1.0:1786100729.743327:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:1.0:1786100729.743340:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+25:14490:x1872861941849344:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786100729.743386:0:14328:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786100729.743528:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+25:14490:x1872861941849344:12345-192.168.206.53@tcp:53:lhsmtool_posix.0 Request processed in 190us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100729.743547:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 42 00000100:00100000:1.0:1786100729.753043:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100729.753302:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941849600 00000100:00100000:0.0:1786100729.753314:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941849600 00000100:00100000:0.0:1786100729.753386:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:0.0:1786100729.753397:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+25:14490:x1872861941849600:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786100729.753424:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786100729.753450:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2367 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33f0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786100729.754512:0:14329:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:0.0:1786100729.754523:0:14329:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1786100729.754585:0:14329:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1786100729.754986:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac236e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.755005:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac236e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.755019:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac236e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.755099:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbba00/0x5564f2c20ac2367 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33f0 expref: 28 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.755121:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac236e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33f0 expref: 27 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.755131:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a3c433df200) 00010000:00010000:0.0:1786100729.755134:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786100729.755139:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c4fbbb000, rc 0) 00000100:00100000:0.0:1786100729.755245:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+27:14490:x1872861941849600:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 1849us (2216us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1786100729.755255:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 43 00000100:00100000:0.0:1786100729.759237:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.760071:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941849856 00000100:00100000:2.0:1786100729.760086:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941849856 00000100:00100000:2.0:1786100729.760208:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:2.0:1786100729.760222:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+27:14490:x1872861941849856:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786100729.760299:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100729.760344:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c4fbbb000/0x5564f2c20ac236e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33f0 expref: 27 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760385:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a3c433df200) 00010000:00010000:2.0:1786100729.760398:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100729.760426:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac237c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760441:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac237c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760452:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac237c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760469:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac2383 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9568618e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760477:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac2383 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9568618e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760484:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac2383 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9568618e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760578:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac237c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760586:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac237c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760593:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac237c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760599:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51fc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100729.760604:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac237c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760619:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac237c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760641:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a3c433dfe00) 00010000:00010000:2.0:1786100729.760645:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100729.760926:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac237c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760936:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac237c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760948:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac2383 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9568618e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760954:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac2383 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9568618e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760959:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac2383 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9568618e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760966:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51fa00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100729.760969:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac2383 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9568618e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760975:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac2383 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9568618e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.760983:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9568618e (ffff9a3c58043e00) 00010000:00010000:2.0:1786100729.760986:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786100729.760989:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac2383 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9568618e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.761005:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fa00/0x5564f2c20ac2383 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9568618e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100729.761133:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+26:14490:x1872861941849856:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 911us (1908us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786100729.761142:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 44 00000100:00100000:0.0:1786100729.763695:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100729.763965:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941849984 00000100:00100000:1.0:1786100729.763977:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941849984 00000100:00100000:1.0:1786100729.764051:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:1.0:1786100729.764063:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+26:14490:x1872861941849984:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786100729.764088:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100729.764118:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac238a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33f7 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.764166:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac2391 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.764295:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac2391 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.764363:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac2391 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.764490:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897400/0x5564f2c20ac238a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33f7 expref: 28 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.764511:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41896800/0x5564f2c20ac2391 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33f7 expref: 27 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.764520:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a3c4627a500) 00010000:00010000:1.0:1786100729.764523:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786100729.764527:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3b41896800, rc 0) 00000100:00100000:1.0:1786100729.764614:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+27:14490:x1872861941849984:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 553us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100729.764623:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 45 00000100:00100000:1.0:1786100729.770586:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100729.770986:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941850240 00000100:00100000:3.0:1786100729.770999:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941850240 00000100:00100000:3.0:1786100729.771076:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:3.0:1786100729.771089:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+27:14490:x1872861941850240:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786100729.771212:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac2398 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.771233:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac2398 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.771247:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac2398 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786100729.771805:0:14329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1786100729.771818:0:14329:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 471014166287ns, next at 472014163632ns, rc = 0 00000004:00010000:3.0:1786100729.771935:0:14329:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e381ce9 reply state 0000000091376b9a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac2398 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100729.771963:0:14329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786100729.772096:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+29:14490:x1872861941850240:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 1008us (1522us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1786100729.772105:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 46 00000100:00100000:2.0:1786100729.777560:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100729.778257:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941850368 00000100:00100000:3.0:1786100729.778270:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941850368 00000100:00100000:3.0:1786100729.778344:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:3.0:1786100729.778356:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+29:14490:x1872861941850368:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786100729.778387:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786100729.778413:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac239f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c33fe expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.778488:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac239f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33fe expref: 30 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.778505:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac239f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33fe expref: 30 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.778528:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a3c4627a500) 00010000:00010000:3.0:1786100729.778532:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786100729.778537:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7fa99400, rc 0) 00000100:00100000:3.0:1786100729.778616:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+30:14490:x1872861941850368:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 262us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100729.778624:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 47 00000100:00100000:3.0:1786100729.781502:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100729.781630:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941850496 00000100:00100000:1.0:1786100729.781642:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941850496 00000100:00100000:1.0:1786100729.781962:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 12 00000100:00100000:1.0:1786100729.781974:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b75cc12d-1273-459a-9324-4254023794ea+5:2352:x1872861941850496:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1786100729.782493:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b75cc12d-1273-459a-9324-4254023794ea+6:2352:x1872861941850496:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 518us (1002us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1786100729.782503:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 12 00010000:00010000:0.0:1786100729.782770:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac2398 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.782784:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac2398 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.782792:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac2398 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.782799:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99c00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100729.782805:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac2398 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.782813:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac2398 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.782832:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a3c4627a500) 00010000:00010000:0.0:1786100729.782835:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786100729.782841:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac2398 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.782847:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac2398 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100729.786093:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100729.787046:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941850752 00000100:00100000:3.0:1786100729.787082:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941850752 00000100:00100000:3.0:1786100729.787209:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:3.0:1786100729.787222:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c473d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b75cc12d-1273-459a-9324-4254023794ea+29:14490:x1872861941850752:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786100729.787556:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c473d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b75cc12d-1273-459a-9324-4254023794ea+30:14490:x1872861941850752:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 335us (1474us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1786100729.787565:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 9 00000100:00100000:2.0:1786100729.792262:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100729.792367:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941851008 00000100:00100000:1.0:1786100729.792381:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941851008 00000100:00100000:1.0:1786100729.792487:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:1.0:1786100729.792499:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+30:14490:x1872861941851008:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786100729.792757:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+30:14490:x1872861941851008:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 260us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100729.792766:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 48 00000100:00100000:1.0:1786100729.796314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.796418:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941851136 00000100:00100000:2.0:1786100729.796430:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941851136 00000100:00100000:2.0:1786100729.796537:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:2.0:1786100729.796550:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+30:14490:x1872861941851136:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786100729.796578:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786100729.796606:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac23a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c3405 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.796992:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.797010:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.797024:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786100729.797071:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786100729.797100:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.797161:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac23a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3405 expref: 32 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.797257:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3405 expref: 31 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.797268:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a3c4627a500) 00010000:00010000:2.0:1786100729.797272:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786100729.797276:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3c7f51e000, rc 0) 00000100:00100000:2.0:1786100729.797408:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+31:14490:x1872861941851136:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 860us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100729.797416:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 49 00000100:00100000:0.0:1786100729.801350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100729.801449:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941851264 00000100:00100000:1.0:1786100729.801462:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941851264 00000100:00100000:1.0:1786100729.801565:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:1.0:1786100729.801578:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b75cc12d-1273-459a-9324-4254023794ea+6:2351:x1872861941851264:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786100729.801603:0:15737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786100729.801632:0:15737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093c4f06d/0x5564f2c20ac23b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5aef8d725a7c340c expref: -99 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786100729.801705:0:15737:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a75bbf9, blocks: 0x1 00010000:00010000:1.0:1786100729.801797:0:15737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1786100729.801803:0:15737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100729.801815:0:15737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093c4f06d/0x5564f2c20ac23b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c340c expref: 7 pid: 15737 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.801838:0:15737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000093c4f06d/0x5564f2c20ac23b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c340c expref: 7 pid: 15737 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100729.801854:0:15737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3b41896e00, rc 0) 00000100:00100000:1.0:1786100729.801928:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b75cc12d-1273-459a-9324-4254023794ea+7:2351:x1872861941851264:12345-192.168.206.53@tcp:101:lhsmtool_posix.0 Request processed in 353us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100729.801936:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:1.0:1786100729.804189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.804278:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941851520 00000100:00100000:2.0:1786100729.804290:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941851520 00000100:00100000:2.0:1786100729.804395:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:2.0:1786100729.804407:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+31:14490:x1872861941851520:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786100729.804552:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+31:14490:x1872861941851520:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 148us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100729.804561:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 50 00000100:00100000:3.0:1786100729.807205:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.807447:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941851648 00000100:00100000:2.0:1786100729.807460:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941851648 00000100:00100000:2.0:1786100729.807529:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:2.0:1786100729.807541:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+31:14490:x1872861941851648:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1786100729.862612:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:0.0:1786100729.862696:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1786100729.862722:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1786100729.862757:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1786100729.862765:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1786100729.863044:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+14:14490:x1872861941851648:12345-192.168.206.53@tcp:44:lhsmtool_posix.0 Request processed in 55497us (55858us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100729.863058:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 51 00000100:00100000:3.0:1786100729.864321:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786100729.864348:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960708352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786100729.864423:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100729.865554:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960708352 00000100:00100000:1.0:1786100729.865569:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960708352 00000100:00100000:1.0:1786100729.865704:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786100729.865718:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960708352:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1786100729.865818:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1786100729.866081:0:15011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786100729.866086:0:15011:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1786100729.866088:0:15011:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786100729.866090:0:15011:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1786100729 -> 1786100729 00002000:00010000:1.0:1786100729.866092:0:15011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786100729.866299:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1872861960708352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 584us (1874us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1786100729.866326:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1786100729.866953:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a3c7c10f480/2, rc 0, transno 8589934595 00000100:00100000:3.0:1786100729.866962:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960708352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786100729.870864:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.871028:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941851776 00000100:00100000:2.0:1786100729.871042:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941851776 00000100:00100000:2.0:1786100729.871140:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:2.0:1786100729.871152:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b75cc12d-1273-459a-9324-4254023794ea+7:2351:x1872861941851776:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1786100729.871321:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b75cc12d-1273-459a-9324-4254023794ea+7:2351:x1872861941851776:12345-192.168.206.53@tcp:16:lhsmtool_posix.0 Request processed in 171us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100729.871330:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 15 00000100:00100000:0.0:1786100729.875963:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.876246:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941852032 00000100:00100000:2.0:1786100729.876259:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941852032 00000100:00100000:2.0:1786100729.876373:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:2.0:1786100729.876386:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+14:14490:x1872861941852032:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786100729.876470:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100729.876507:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c3405 expref: 14 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.876528:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a3c4627a500) 00010000:00010000:2.0:1786100729.876534:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786100729.876572:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac23bb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.876587:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac23bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.876597:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac23bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786100729.876910:0:14328:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb6b838d reply state 00000000b34287b9 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac23bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100729.876921:0:14328:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786100729.877058:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b75cc12d-1273-459a-9324-4254023794ea+15:14490:x1872861941852032:12345-192.168.206.53@tcp:36:lhsmtool_posix.0 Request processed in 674us (1109us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1786100729.877066:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 52 00000100:00100000:1.0:1786100729.880267:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100729.881214:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941852160 00000100:00100000:3.0:1786100729.881230:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941852160 00000100:00100000:3.0:1786100729.881307:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:3.0:1786100729.881319:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b75cc12d-1273-459a-9324-4254023794ea+7:2351:x1872861941852160:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1786100729.881586:0:15011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1786100729.881590:0:15011:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1786100728 00002000:00010000:3.0:1786100729.881593:0:15011:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1786100728 00002000:00010000:3.0:1786100729.881595:0:15011:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1786100729 -> 1786100728 00002000:00010000:3.0:1786100729.881598:0:15011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:0.0:1786100729.881986:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac23bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.881998:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac23bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.882006:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac23bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.882013:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51fc00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:0.0:1786100729.882018:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac23bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.882027:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac23bb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.882046:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a3c4627a500) 00010000:00010000:0.0:1786100729.882050:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786100729.882055:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac23bb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.882061:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51fc00/0x5564f2c20ac23bb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100729.882169:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b75cc12d-1273-459a-9324-4254023794ea+8:2351:x1872861941852160:12345-192.168.206.53@tcp:2:lhsmtool_posix.0 Request processed in 849us (1912us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1786100729.882207:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 16 00000100:00100000:0.0:1786100729.884888:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.885002:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941852288 00000100:00100000:2.0:1786100729.885013:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941852288 00000100:00100000:2.0:1786100729.885130:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:2.0:1786100729.885142:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b75cc12d-1273-459a-9324-4254023794ea+8:2352:x1872861941852288:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786100729.885294:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac23c2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.885315:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100729.885321:0:15010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100729.885328:0:15010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac23c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.885342:0:15010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac23c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.885379:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac23c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.885389:0:15010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac23c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.885397:0:15010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac23c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.885428:0:15010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e000 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100729.885433:0:15010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac23c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.885443:0:15010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac23c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.885460:0:15010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac23c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.885470:0:15010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac23c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100729.885593:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b75cc12d-1273-459a-9324-4254023794ea+8:2352:x1872861941852288:12345-192.168.206.53@tcp:1:lhsmtool_posix.0 Request processed in 452us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100729.885600:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:0.0:1786100729.888556:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100729.889048:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941852544 00000100:00100000:3.0:1786100729.889062:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941852544 00000100:00100000:3.0:1786100729.889138:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 53 00000100:00100000:3.0:1786100729.889151:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+14:14490:x1872861941852544:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786100729.889359:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac23c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.889381:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac23c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.889394:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac23c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.889891:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.889906:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac239f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33fe expref: 15 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.889915:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.889956:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac239f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33fe expref: 15 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.889971:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac239f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33fe expref: 15 pid: 14330 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100729.890003:0:14329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14329:1872861960708480:192.168.206.53@tcp:104: 00000100:00100000:3.0:1786100729.890172:0:14329:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c7490bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786100729.894257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.894335:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941852672 00000100:00100000:2.0:1786100729.894347:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941852672 00010000:00010000:2.0:1786100729.894400:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac239f lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33fe expref: 16 pid: 14330 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100729.894447:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 13 00000100:00100000:2.0:1786100729.894459:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c237b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b75cc12d-1273-459a-9324-4254023794ea+16:2351:x1872861941852672:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786100729.894480:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786100729.894500:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac239f lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33fe expref: 16 pid: 14330 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.894515:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac239f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33fe expref: 16 pid: 14330 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.894543:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a3c4627a500) 00010000:00010000:2.0:1786100729.894548:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.894560:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.894568:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.894590:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786100729.894706:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c237b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b75cc12d-1273-459a-9324-4254023794ea+16:2351:x1872861941852672:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 247us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100729.894714:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 13 00010000:00010000:3.0:1786100729.897013:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac239f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33fe expref: 15 pid: 14330 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100729.897045:0:14329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14329:1872861960708480:192.168.206.53@tcp:104: 00010000:00010000:3.0:1786100729.897076:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.897324:0:14329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.897333:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786100729.897597:0:14329:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1786100729.898169:0:14329:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1786100729.898301:0:14329:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1786100729.898404:0:14329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44765500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14329:1872861960708608:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786100729.898491:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100729.898590:0:14329:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734900 going to sleep for 11 seconds 00000100:00100000:3.0:1786100729.898979:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960708608 00000100:00100000:3.0:1786100729.898988:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960708608 00000100:00100000:3.0:1786100729.899094:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786100729.899106:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14329:x1872861960708608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786100729.899220:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14329:x1872861960708608:12345-0@lo:1000:mdt00_001.0 Request processed in 116us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100729.899227:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786100729.899294:0:14329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44765500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14329:1872861960708608:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1786100729.900072:0:14329:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1786100729.900164:0:14329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44765500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14329:1872861960708736:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786100729.900231:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100729.901619:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960708736 00000100:00100000:0.0:1786100729.901635:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960708736 00000100:00100000:0.0:1786100729.901719:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786100729.901739:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14329:x1872861960708736:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786100729.902047:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14329:x1872861960708736:12345-0@lo:1000:mdt00_001.0 Request processed in 317us (1814us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1786100729.902055:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786100729.903466:0:14329:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786100729.903526:0:14329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44765500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14329:1872861960708736:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1786100729.903585:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.903597:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.903606:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.903612:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99600 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100729.903617:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.903624:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.903643:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a3c4627a500) 00010000:00010000:2.0:1786100729.903646:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786100729.903665:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.903672:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99600/0x5564f2c20ac23d0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.903991:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac232f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.903998:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac232f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.904004:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac232f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.904010:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897000 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:2.0:1786100729.904014:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac232f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.904020:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac232f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.904030:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:2.0:1786100729.904033:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786100729.904042:0:14329:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2336 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33e2 expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.904054:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2336 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33e2 expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.904064:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2336 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33e2 expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.904143:0:14329:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e200/0x5564f2c20ac2336 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c33e2 expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100729.904174:0:14329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44766a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14329:1872861960708864:192.168.206.53@tcp:105: 00000100:00100000:2.0:1786100729.905062:0:14329:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d7349c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786100729.911059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.911101:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941852800 00000100:00100000:2.0:1786100729.911114:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941852800 00000100:00100000:2.0:1786100729.911194:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:2.0:1786100729.911207:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c45816050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b75cc12d-1273-459a-9324-4254023794ea+19:14489:x1872861941852800:12345-192.168.206.53@tcp:49:dd.0 00000100:00100000:2.0:1786100729.911379:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c45816050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b75cc12d-1273-459a-9324-4254023794ea+19:14489:x1872861941852800:12345-192.168.206.53@tcp:49:dd.0 Request processed in 174us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100729.911388:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 10 00000100:00100000:3.0:1786100729.911533:0:14329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44766a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14329:1872861960708864:192.168.206.53@tcp:105: 00010000:00010000:3.0:1786100729.911565:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac232f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911577:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3b41897000/0x5564f2c20ac232f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911616:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac23d7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911687:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac23d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911702:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac23d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911713:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac23d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911720:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac23d7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911727:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac23d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911740:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99400 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100729.911745:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac23d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911752:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac23d7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911764:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:3.0:1786100729.911767:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786100729.911772:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac23d7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911778:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99400/0x5564f2c20ac23d7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911789:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac23c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911803:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac23c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911808:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac23c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911814:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99c00 already unused, calling callback (ffffffffc20ce4f0) 00010000:00010000:3.0:1786100729.911817:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac23c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911823:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac23c9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911832:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a3c454abc00) 00010000:00010000:3.0:1786100729.911835:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786100729.911838:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac23c9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100729.911843:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7fa99c00/0x5564f2c20ac23c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100729.912083:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b75cc12d-1273-459a-9324-4254023794ea+18:14490:x1872861941852544:12345-192.168.206.53@tcp:57:lhsmtool_posix.0 Request processed in 22933us (23538us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1786100729.912093:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 53 00000020:00080000:3.0:1786100729.912097:0:14329:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1786100729.912356:0:14362:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1786100729.912362:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786100729.912410:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1786100729.912418:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1786100729.917823:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100729.917872:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941853056 00000100:00100000:2.0:1786100729.917885:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941853056 00000100:00100000:2.0:1786100729.917957:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 11 00000100:00100000:2.0:1786100729.917969:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b75cc12d-1273-459a-9324-4254023794ea+18:14490:x1872861941853056:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1786100729.919127:0:14332:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1786100729.919503:0:14332:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1786100729.919567:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23de lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.919587:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.919612:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.919622:0:14332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23de lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.920281:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23de lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.920292:0:14332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100729.920378:0:14332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786100729.920525:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b75cc12d-1273-459a-9324-4254023794ea+20:14490:x1872861941853056:12345-192.168.206.53@tcp:35:lhsmtool_posix.0 Request processed in 2554us (2713us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1786100729.920536:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 11 00000020:00080000:2.0:1786100729.920543:0:14332:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786100729.926969:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786100729.926990:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23de lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.927003:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e000 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100729.927008:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23de lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.927020:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.927044:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a3c4627a500) 00010000:00010000:0.0:1786100729.927047:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786100729.927053:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23de lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.927059:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3c7f51e000/0x5564f2c20ac23de lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100729.927080:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100729.927082:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786100729.927084:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786100730.066843:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100730.066895:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100730.070069:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941853184 00000100:00100000:0.0:1786100730.070115:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941853184 00000100:00100000:0.0:1786100730.070238:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941853312 00000100:00100000:0.0:1786100730.070242:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941853312 00000100:00100000:0.0:1786100730.070281:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:0.0:1786100730.070294:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b75cc12d-1273-459a-9324-4254023794ea+9:2353:x1872861941853184:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:0.0:1786100730.070339:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.070364:0:15016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000093c4f06d/0x5564f2c20ac23b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c340c expref: 9 pid: 15737 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786100730.070498:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786100730.070587:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100730.070594:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100730.070599:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.070716:0:15016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000093c4f06d/0x5564f2c20ac23b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c340c expref: 9 pid: 15737 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.070734:0:15016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000093c4f06d/0x5564f2c20ac23b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c340c expref: 9 pid: 15737 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100730.070754:0:15016:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44765880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15016:1872861960708992:192.168.206.53@tcp:104: 00000100:00100000:2.0:1786100730.070899:0:15016:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a3c6d734840 going to sleep for 11 seconds 00000100:00100000:2.0:1786100730.071856:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100730.071891:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100730.071931:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:2.0:1786100730.071945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100730.072202:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1786100730.072212:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1786100730.072734:0:15015:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1786100730.072753:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941853568 00000100:00100000:0.0:1786100730.072764:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941853568 00000100:00100000:0.0:1786100730.072888:0:15015:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1786100730.072896:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941853440 00000100:00100000:0.0:1786100730.072899:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941853440 00000100:00100000:0.0:1786100730.072915:0:15015:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1786100730.072919:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941853696 00000100:00100000:0.0:1786100730.072922:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941853696 00000100:00100000:0.0:1786100730.072934:0:15015:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1786100730.072941:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941853824 00000100:00100000:0.0:1786100730.072944:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941853824 00000100:00100000:3.0:1786100730.074294:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:3.0:1786100730.074312:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b75cc12d-1273-459a-9324-4254023794ea+13:2353:x1872861941853312:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:3.0:1786100730.074442:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100730.074467:0:16551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100730.074474:0:16551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786100730.074478:0:16551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100730.074490:0:16551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100730.074912:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100730.075219:0:15015:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1786100730.075231:0:15015:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1786100730.075615:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941853952 00000100:00100000:0.0:1786100730.075640:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941853952 00000100:00100000:0.0:1786100730.076582:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:1.0:1786100730.077491:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941854080 00000100:00100000:1.0:1786100730.077504:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941854080 00010000:00010000:1.0:1786100730.077556:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000093c4f06d/0x5564f2c20ac23b4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c340c expref: 15 pid: 15737 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100730.077606:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 14 00000100:00100000:1.0:1786100730.077617:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b75cc12d-1273-459a-9324-4254023794ea+15:2351:x1872861941854080:12345-192.168.206.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786100730.077637:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786100730.077688:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000093c4f06d/0x5564f2c20ac23b4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c340c expref: 15 pid: 15737 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.077703:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000093c4f06d/0x5564f2c20ac23b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c340c expref: 15 pid: 15737 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.077735:0:14314:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100730.077741:0:14314:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100730.077748:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.077758:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.077785:0:14314:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100730.077788:0:14314:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100730.077799:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.077808:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.077840:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786100730.077915:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b75cc12d-1273-459a-9324-4254023794ea+15:2351:x1872861941854080:12345-192.168.206.53@tcp:103:ldlm_bl.0 Request processed in 299us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100730.077924:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 14 00010000:00010000:1.0:1786100730.078867:0:16551:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.078882:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100730.080571:0:16552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:2.0:1786100730.080598:0:16552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b75cc12d-1273-459a-9324-4254023794ea+14:2354:x1872861941853568:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:2.0:1786100730.080666:0:16552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d365dd9a/0x5564f2c20ac23f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.080690:0:16552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100730.080695:0:16552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100730.080703:0:16552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d365dd9a/0x5564f2c20ac23f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.080719:0:16552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d365dd9a/0x5564f2c20ac23f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100730.086077:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093c4f06d/0x5564f2c20ac23b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.53@tcp remote: 0x5aef8d725a7c340c expref: 14 pid: 15737 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100730.086108:0:15016:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44765880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15016:1872861960708992:192.168.206.53@tcp:104: 00010000:00010000:3.0:1786100730.086143:0:15016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100730.086158:0:15016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100730.086165:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100730.086717:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:0.0:1786100730.087545:0:15015:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1786100730.087558:0:15015:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1786100730.087757:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941854208 00000100:00100000:0.0:1786100730.087766:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941854208 00000100:00100000:0.0:1786100730.090197:0:16553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:0.0:1786100730.090223:0:16553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b75cc12d-1273-459a-9324-4254023794ea+17:2354:x1872861941853440:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:0.0:1786100730.090276:0:16553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac23fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.090298:0:16553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100730.090304:0:16553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100730.090311:0:16553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac23fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.090326:0:16553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac23fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786100730.225229:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:1.0:1786100730.225258:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:1.0:1786100730.225264:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1786100730.226764:0:16551:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1786100730.226775:0:16551:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1786100728 -> 1786100729 00002000:00010000:2.0:1786100730.226779:0:16551:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1786100728 -> 1786100729 00002000:00010000:2.0:1786100730.226781:0:16551:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1786100730.226799:0:16551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.226815:0:16551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.226825:0:16551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.226857:0:16551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7fa99c00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100730.226863:0:16551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.226873:0:16551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.226899:0:16551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.226908:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000db32547/0x5564f2c20ac23ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786100730.227039:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b75cc12d-1273-459a-9324-4254023794ea+21:2353:x1872861941853312:12345-192.168.206.53@tcp:4:dd.0 Request processed in 152717us (160129us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1786100730.227050:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 1 00000100:00100000:2.0:1786100730.227090:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 4 00000100:00100000:2.0:1786100730.227105:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b75cc12d-1273-459a-9324-4254023794ea+20:2353:x1872861941853696:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:2.0:1786100730.227145:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac2401 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.227170:0:16551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100730.227185:0:16551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786100730.227193:0:16551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac2401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.227219:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac2401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100730.276991:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7c237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960709120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786100730.277081:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786100730.277184:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960709120 00000100:00100000:1.0:1786100730.277194:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960709120 00000100:00100000:1.0:1786100730.277304:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786100730.277315:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960709120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786100730.277344:0:15014:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 6815744 free 3859808256 avail 3856662528 00000100:00100000:1.0:1786100730.277745:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1872861960709120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 431us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100730.277754:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786100730.277802:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1786100730.277807:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a3c7c10f480, transno 8589934595 00000004:00080000:1.0:1786100730.277818:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1786100730.277849:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7c237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1872861960709120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786100730.282534:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1786100730.282590:0:15016:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1786100730.282597:0:15016:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 8199 00010000:00010000:0.0:1786100730.282615:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.282630:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.282640:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.282684:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbba00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100730.282690:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.282701:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.282729:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.282737:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5e750b9/0x5564f2c20ac23e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100730.282857:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b75cc12d-1273-459a-9324-4254023794ea+22:2353:x1872861941853184:12345-192.168.206.53@tcp:4:dd.0 Request processed in 212558us (216022us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1786100730.282869:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 0 00000100:00100000:0.0:1786100730.282914:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 5 00000100:00100000:0.0:1786100730.282928:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b75cc12d-1273-459a-9324-4254023794ea+21:2354:x1872861941853824:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:0.0:1786100730.282967:0:15016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026774584/0x5564f2c20ac2408 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.282983:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100730.282988:0:15016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786100730.282995:0:15016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026774584/0x5564f2c20ac2408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.283020:0:15016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026774584/0x5564f2c20ac2408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.284337:0:16552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d365dd9a/0x5564f2c20ac23f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.284358:0:16552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d365dd9a/0x5564f2c20ac23f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.284369:0:16552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d365dd9a/0x5564f2c20ac23f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.284377:0:16552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51f400 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100730.284382:0:16552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d365dd9a/0x5564f2c20ac23f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.284392:0:16552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d365dd9a/0x5564f2c20ac23f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.284416:0:16552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d365dd9a/0x5564f2c20ac23f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.284442:0:16552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d365dd9a/0x5564f2c20ac23f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100730.284536:0:16552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b75cc12d-1273-459a-9324-4254023794ea+20:2354:x1872861941853568:12345-192.168.206.53@tcp:4:dd.0 Request processed in 203945us (212681us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1786100730.284552:0:16552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 2 00000100:00100000:1.0:1786100730.284589:0:16552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 6 00000100:00100000:1.0:1786100730.284604:0:16552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b75cc12d-1273-459a-9324-4254023794ea+19:2353:x1872861941853952:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:1.0:1786100730.284641:0:16552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008040c862/0x5564f2c20ac240f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.284683:0:16552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100730.284689:0:16552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100730.284695:0:16552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008040c862/0x5564f2c20ac240f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.284709:0:16552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008040c862/0x5564f2c20ac240f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786100730.285370:0:16553:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1786100730.285385:0:16553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac23fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.285395:0:16553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac23fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.285418:0:16553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac23fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.285425:0:16553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4fbbb800 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100730.285430:0:16553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac23fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.285439:0:16553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac23fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.285455:0:16553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac23fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.285463:0:16553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cb4c8c2/0x5564f2c20ac23fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100730.285512:0:16553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b75cc12d-1273-459a-9324-4254023794ea+19:2354:x1872861941853440:12345-192.168.206.53@tcp:4:dd.0 Request processed in 195297us (213617us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1786100730.285520:0:16553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 3 00000100:00100000:1.0:1786100730.285544:0:16553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 7 00000100:00100000:1.0:1786100730.285553:0:16553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7c235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b75cc12d-1273-459a-9324-4254023794ea+18:2354:x1872861941854208:12345-192.168.206.53@tcp:4:dd.0 00010000:00010000:1.0:1786100730.285577:0:16553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a6543b/0x5564f2c20ac2416 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.285585:0:16553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100730.285595:0:16553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786100730.285600:0:16553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011a6543b/0x5564f2c20ac2416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.285610:0:16553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011a6543b/0x5564f2c20ac2416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786100730.287473:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:2.0:1786100730.342284:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:0.0:1786100730.342833:0:16551:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7654321 00010000:00010000:0.0:1786100730.342857:0:16551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac2401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.342872:0:16551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac2401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.342882:0:16551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac2401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.342891:0:16551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c7f51e000 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:0.0:1786100730.342896:0:16551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac2401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.342906:0:16551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac2401 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.342932:0:16551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac2401 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786100730.342940:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e9e5c38/0x5564f2c20ac2401 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786100730.343076:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b75cc12d-1273-459a-9324-4254023794ea+17:2353:x1872861941853696:12345-192.168.206.53@tcp:4:dd.0 Request processed in 115969us (271137us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1786100730.343087:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 4 00002000:00010000:3.0:1786100730.424294:0:16552:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 16391 00010000:00010000:3.0:1786100730.424324:0:16552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008040c862/0x5564f2c20ac240f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100730.424356:0:16552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008040c862/0x5564f2c20ac240f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100730.424366:0:16552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008040c862/0x5564f2c20ac240f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100730.424373:0:16552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41897e00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:3.0:1786100730.424378:0:16552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008040c862/0x5564f2c20ac240f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100730.424387:0:16552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008040c862/0x5564f2c20ac240f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.424560:0:15016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026774584/0x5564f2c20ac2408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.424570:0:15016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026774584/0x5564f2c20ac2408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.424576:0:15016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026774584/0x5564f2c20ac2408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.424582:0:15016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3c4165ec00 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:1.0:1786100730.424586:0:15016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026774584/0x5564f2c20ac2408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.424594:0:15016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026774584/0x5564f2c20ac2408 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.424609:0:15016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026774584/0x5564f2c20ac2408 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786100730.424616:0:15016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026774584/0x5564f2c20ac2408 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786100730.424786:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b75cc12d-1273-459a-9324-4254023794ea+15:2354:x1872861941853824:12345-192.168.206.53@tcp:4:dd.0 Request processed in 141855us (352832us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1786100730.424798:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 5 00010000:00010000:3.0:1786100730.424926:0:16552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008040c862/0x5564f2c20ac240f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786100730.424935:0:16552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008040c862/0x5564f2c20ac240f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786100730.424976:0:16552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b75cc12d-1273-459a-9324-4254023794ea+13:2353:x1872861941853952:12345-192.168.206.53@tcp:4:dd.0 Request processed in 140377us (350066us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1786100730.424984:0:16552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 6 00010000:00010000:2.0:1786100730.425533:0:16553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a6543b/0x5564f2c20ac2416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.425546:0:16553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011a6543b/0x5564f2c20ac2416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.425554:0:16553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011a6543b/0x5564f2c20ac2416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.425561:0:16553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a3b41896600 already unused, calling callback (ffffffffc1691fd0) 00010000:00010000:2.0:1786100730.425564:0:16553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a6543b/0x5564f2c20ac2416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.425572:0:16553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a6543b/0x5564f2c20ac2416 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.425586:0:16553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011a6543b/0x5564f2c20ac2416 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786100730.425593:0:16553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011a6543b/0x5564f2c20ac2416 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786100730.425729:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00000100:00100000:2.0:1786100730.425937:0:16553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7c235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b75cc12d-1273-459a-9324-4254023794ea+5:2354:x1872861941854208:12345-192.168.206.53@tcp:4:dd.0 Request processed in 140383us (339220us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1786100730.425946:0:16553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 7 00010000:00010000:3.0:1786100731.302542:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786100731.946062:0:14362:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1786100731.946073:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786100731.946107:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1786100731.946115:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:2.0:1786100732.250565:0:16591:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1786100732.324887:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c44f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960709248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786100732.325119:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960709504:0@lo:400:kworker.0 00000100:00100000:0.0:1786100732.327175:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100732.327664:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100732.327719:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960709760:0@lo:400:kworker.0 00000100:00100000:3.0:1786100732.327763:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100732.327789:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786100732.327796:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0af484e0-17d7-4fef-8244-23d93563e204:3307:1872861960709376:0@lo:400:kworker.0 00000100:00100000:3.0:1786100732.327824:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100732.327849:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960709888:0@lo:400:kworker.0 00000100:00100000:3.0:1786100732.327871:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786100732.327910:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960709248 00000100:00100000:3.0:1786100732.327918:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960709248 00000100:00100000:0.0:1786100732.328042:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960710016:0@lo:400:kworker.0 00000100:00100000:0.0:1786100732.328074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786100732.328100:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786100732.328106:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a3c7f3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960709632:0@lo:400:kworker.0 00000100:00100000:0.0:1786100732.328131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786100732.328141:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960709760 00000100:00100000:2.0:1786100732.328148:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960709760 00000100:00100000:2.0:1786100732.328202:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960709888 00000100:00100000:2.0:1786100732.328205:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960709888 00000100:00100000:2.0:1786100732.328217:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960710016 00000100:00100000:2.0:1786100732.328219:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960710016 00000100:00100000:2.0:1786100732.328233:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786100732.328243:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960709760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100732.328307:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872861960709760:12345-0@lo:400:kworker.0 Request processed in 65us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100732.328314:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786100732.328331:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786100732.328337:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960709888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100732.328360:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872861960709888:12345-0@lo:400:kworker.0 Request processed in 24us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100732.328366:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786100732.328376:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786100732.328381:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1872861960710016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786100732.328410:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1872861960710016:12345-0@lo:400:kworker.0 Request processed in 28us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1786100732.328415:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1786100732.328462:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786100732.328506:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1872861960710016:0@lo:400:kworker.0 00000100:00100000:3.0:1786100732.328624:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786100732.328633:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960709248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786100732.328694:0:15014:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786100732.328737:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872861960709248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100732.328743:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786100732.328830:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960709504 00000100:00100000:1.0:1786100732.328836:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960709504 00000100:00100000:3.0:1786100732.328869:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960709376 00000100:00100000:3.0:1786100732.328874:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960709376 00000100:00100000:1.0:1786100732.328886:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861960709632 00000100:00100000:1.0:1786100732.328891:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861960709632 00000100:00100000:3.0:1786100732.328909:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1786100732.328919:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+19:3307:x1872861960709376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100732.328925:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786100732.328949:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c7f3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960709504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786100732.329042:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786100732.329051:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c451e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960709632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786100732.329140:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c7f3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960709504:12345-0@lo:400:kworker.0 Request processed in 194us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1786100732.329149:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786100732.329160:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c451e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1872861960709632:12345-0@lo:400:kworker.0 Request processed in 109us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1786100732.329178:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786100732.329214:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960709632:0@lo:400:kworker.0 00000100:00100000:0.0:1786100732.329225:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1872861960709504:0@lo:400:kworker.0 00000100:00100000:3.0:1786100732.329420:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0af484e0-17d7-4fef-8244-23d93563e204+19:3307:x1872861960709376:12345-0@lo:400:kworker.0 Request processed in 502us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100732.329428:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1786100732.329462:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786100732.329467:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786100732.329469:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786100732.329512:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0af484e0-17d7-4fef-8244-23d93563e204:3307:1872861960709376:0@lo:400:kworker.0 00000100:00100000:3.0:1786100732.329525:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1872861960709888:0@lo:400:kworker.0 00000100:00100000:3.0:1786100732.329537:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c7f3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872861960709760:0@lo:400:kworker.0 00000100:00100000:3.0:1786100732.329555:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a3c44f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1872861960709248:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786100733.348898:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786100733.581518:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100733.581564:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100733.581590:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100733.581614:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100733.581641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100733.581691:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100733.581717:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.53@tcp (source: 12345-192.168.206.53@tcp) 00000100:00100000:3.0:1786100733.581748:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941854336 00000100:00100000:3.0:1786100733.581761:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941854336 00000100:00100000:3.0:1786100733.581823:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 123 00000100:00100000:3.0:1786100733.581834:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c71bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+13:2354:x1872861941854336:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100733.581926:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c71bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1995a8cb-3604-41be-a0eb-37e324c5086a+13:2354:x1872861941854336:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 93us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100733.581935:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 123 00000100:00100000:3.0:1786100733.581974:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941854464 00000100:00100000:3.0:1786100733.581978:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941854464 00000100:00100000:3.0:1786100733.582014:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941854848 00000100:00100000:3.0:1786100733.582017:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941854848 00000100:00100000:3.0:1786100733.582033:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:3.0:1786100733.582039:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+20:2354:x1872861941854464:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100733.582093:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b75cc12d-1273-459a-9324-4254023794ea+20:2354:x1872861941854464:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 54us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100733.582119:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 28 00000100:00100000:3.0:1786100733.582133:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:3.0:1786100733.582139:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:2354:x1872861941854848:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100733.582179:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+6:2354:x1872861941854848:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 39us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100733.582185:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 29 00000100:00100000:3.0:1786100733.582203:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941854592 00000100:00100000:3.0:1786100733.582207:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941854592 00000100:00100000:3.0:1786100733.582228:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941854720 00000100:00100000:3.0:1786100733.582231:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941854720 00000100:00100000:3.0:1786100733.582242:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941854976 00000100:00100000:3.0:1786100733.582245:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941854976 00000100:00100000:3.0:1786100733.582256:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872861941855104 00000100:00100000:3.0:1786100733.582258:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872861941855104 00000100:00100000:3.0:1786100733.582321:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:3.0:1786100733.582328:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b75cc12d-1273-459a-9324-4254023794ea+5:2354:x1872861941854592:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100733.582356:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b75cc12d-1273-459a-9324-4254023794ea+5:2354:x1872861941854592:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 29us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100733.582363:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 17 00000100:00100000:3.0:1786100733.582376:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:3.0:1786100733.582382:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c44f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b75cc12d-1273-459a-9324-4254023794ea+5:2354:x1872861941854720:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100733.582406:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c44f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b75cc12d-1273-459a-9324-4254023794ea+5:2354:x1872861941854720:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 23us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100733.582413:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 18 00000100:00100000:3.0:1786100733.582424:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:3.0:1786100733.582437:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:2354:x1872861941854976:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100733.582461:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:2354:x1872861941854976:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 26us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100733.582466:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 19 00000100:00100000:3.0:1786100733.582476:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00100000:3.0:1786100733.582481:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3c745d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:2354:x1872861941855104:12345-192.168.206.53@tcp:400:kworker.0 00000100:00100000:3.0:1786100733.582500:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3c745d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d1d6a4e-1be1-4bbc-a4f1-b399ad84d99c+5:2354:x1872861941855104:12345-192.168.206.53@tcp:400:kworker.0 Request processed in 19us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1786100733.582505:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.53@tcp, seq: 20 00000100:00080000:3.0:1786100733.582545:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786100733.582549:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786100733.582553:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 Debug log: 29291 lines, 29291 kept, 0 dropped, 0 bad.